-- Logs begin at Thu 2022-09-15 11:45:00 UTC, end at Thu 2022-09-15 12:53:04 UTC. -- Sep 15 12:15:32.443551 dv-cinder-850836-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 12:15:32.451714 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 12:15:32 2022] *** Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: nodename: dv-cinder-850836-7-iscsi Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: machine: x86_64 Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: clock source: unix Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: pcre jit disabled Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: detected number of CPU cores: 4 Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: current working directory: / Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: detected binary path: /usr/bin/uwsgi-core Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: your processes number limit is 47680 Sep 15 12:15:32.453720 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: your memory page size is 4096 bytes Sep 15 12:15:32.454617 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: detected max file descriptor number: 2048 Sep 15 12:15:32.454617 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: lock engine: pthread robust mutexes Sep 15 12:15:32.454617 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: thunder lock: enabled Sep 15 12:15:32.454617 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 12:15:32.454617 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 12:15:32.493524 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: Python main interpreter initialized at 0x563b0840f9c0 Sep 15 12:15:32.493524 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: python threads support enabled Sep 15 12:15:32.493524 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: your server socket listen backlog is limited to 100 connections Sep 15 12:15:32.493524 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: your mercy for graceful operations on workers is 90 seconds Sep 15 12:15:32.493867 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 12:15:32.493948 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: *** Operational MODE: preforking *** Sep 15 12:15:32.494196 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: *** uWSGI is running in multiple interpreter mode *** Sep 15 12:15:32.494196 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: spawned uWSGI master process (pid: 105458) Sep 15 12:15:32.494388 dv-cinder-850836-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 12:15:32.496703 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: spawned uWSGI worker 1 (pid: 105459, cores: 1) Sep 15 12:15:32.496703 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: spawned uWSGI worker 2 (pid: 105460, cores: 1) Sep 15 12:15:32.496703 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 12:15:33.153519 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:15:33.154113 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:15:34.233462 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:15:34.233462 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: from cryptography.utils import int_from_bytes Sep 15 12:15:34.234123 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:15:34.234123 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: from cryptography.utils import int_from_bytes Sep 15 12:15:34.238347 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:15:34.238347 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: from cryptography.utils import int_from_bytes Sep 15 12:15:34.238800 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:15:34.238800 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: from cryptography.utils import int_from_bytes Sep 15 12:15:36.693138 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:15:36.693705 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:15:36.693871 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:15:36.694289 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:15:36.694377 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:15:36.694478 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:15:36.694478 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:15:36.694624 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:15:36.694864 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.694953 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:15:36.695186 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.695282 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:15:36.695507 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.695594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.695823 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.695917 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.696150 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.696239 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.696460 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.696546 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.696801 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.696904 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697109 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697202 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697426 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697511 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697682 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697769 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.697994 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698087 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698282 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698374 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-7-iscsi {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698590 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698677 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698908 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-7-iscsi {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.698994 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.699214 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.699297 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.699510 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.699595 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.699812 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.699905 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.700122 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.700217 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.700420 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.700507 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.700733 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.700937 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.701369 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.701517 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.701633 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.701750 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.701856 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.701961 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.702105 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.702321 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.702473 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.702597 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.702719 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.702895 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703035 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703248 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703390 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703517 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703640 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703821 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.703962 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.704129 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.704266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.704464 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.704601 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-7-iscsi {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.704844 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.704988 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-7-iscsi {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.705158 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.705303 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.705460 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.705587 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.705766 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.705887 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.706164 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.706304 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.706467 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.706594 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.706770 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.706892 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.707081 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.707212 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.707395 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.707531 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.707699 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.707836 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.708065 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.708203 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.708866 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709002 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709185 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709315 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709486 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709612 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709784 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.709924 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710086 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710224 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710388 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710516 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710725 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710857 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.710982 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711105 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711235 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711360 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711482 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711617 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711785 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.711913 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712099 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712235 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712412 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712543 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712677 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712828 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.712968 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713108 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713235 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713440 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713571 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713710 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713840 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.713983 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714116 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714240 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714385 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714522 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714685 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714824 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.714984 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.715120 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.715285 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.715417 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.715582 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.715710 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.715880 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716008 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716220 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716379 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716521 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716646 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716796 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.716923 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.717102 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.717231 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.717405 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.717537 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.717717 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.717845 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718038 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718241 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718385 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718516 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718641 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718772 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.718941 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719083 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719251 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719379 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719550 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719679 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719860 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.719998 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.720160 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.720286 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.720447 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.720579 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.720741 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.720905 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.721061 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.721196 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.721370 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.721498 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.721686 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.721890 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.722275 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.722403 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.722526 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.722655 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.722789 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.722914 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.723036 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.723159 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.723323 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.723471 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.723680 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.723810 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.724532 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.724672 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.724815 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.724955 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725089 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725214 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725465 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725637 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725766 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.725935 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726074 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726234 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726363 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726533 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726668 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726831 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.726959 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.727124 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.727251 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.727421 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.727562 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.727717 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.727846 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728018 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728182 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728327 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728466 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728622 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728774 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.728945 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729105 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729248 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729382 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729514 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729811 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.729940 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.730123 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.730252 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.730422 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.730553 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.730720 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.730849 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731024 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731159 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731456 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731615 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731749 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.731922 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.732061 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.732217 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.732350 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.732514 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.732649 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.732861 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733004 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733130 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733254 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733412 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733551 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733758 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.733901 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734035 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734159 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734281 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734404 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734566 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734703 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734860 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.734999 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.735154 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.735289 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.735450 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.735580 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.735742 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.735879 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736036 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736326 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736456 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736633 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736792 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.736964 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737090 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737263 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737390 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737561 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737697 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737859 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.737998 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.738174 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:15:36.738303 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.738500 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.738628 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.738824 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.738963 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.739135 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.739268 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.739452 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.739580 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.739805 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.739944 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.740123 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.740260 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.740433 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.740577 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.740735 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.740886 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741067 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741207 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741373 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741499 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741678 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741806 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.741983 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.742119 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.742287 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.742415 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.742597 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.742811 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.742944 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.743069 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.743216 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.743344 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.743525 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.743654 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.743869 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744021 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744147 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744268 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744431 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744567 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744742 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.744895 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.745081 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.745208 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.745391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.745521 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.745696 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.745822 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746028 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746157 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746352 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746479 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746659 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746792 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.746977 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.747115 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.747290 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.747424 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.747594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.747728 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.747901 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.748039 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.748212 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.748349 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.748536 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.748674 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.748873 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749018 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749194 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749322 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749504 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749632 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749819 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.749955 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.750127 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.750254 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.750429 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.750556 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.750734 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.750864 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751039 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751176 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751342 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751479 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751644 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751774 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.751971 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.752107 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.752278 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.752413 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.752589 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.752724 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.752926 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.753065 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.753231 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.753365 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.753541 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.753677 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.753843 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754055 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754194 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754320 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754451 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754582 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754713 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.754836 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755002 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755141 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755337 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755464 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755638 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755765 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.755935 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.756077 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.756247 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.756377 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.756555 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.756682 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.756879 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757020 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757204 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757334 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757505 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757640 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757808 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.757946 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.758116 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.758243 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.758418 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.758557 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.758716 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.758847 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759022 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759148 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759324 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759451 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759752 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.759938 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.760067 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.760241 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.760368 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.760538 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.760668 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.760874 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761003 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761173 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761299 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761474 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761605 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761781 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.761908 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762083 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762219 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762388 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762518 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762695 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762821 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.762996 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.763132 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.763311 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.763452 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.763617 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.763746 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.763920 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764073 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764263 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764392 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764552 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764679 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.764997 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.765178 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.765314 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.765495 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.765624 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.765796 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.765925 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766092 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766226 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766392 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766519 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766688 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766824 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.766986 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.767116 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.767284 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.767425 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.767582 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.767725 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.767878 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768006 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768177 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768303 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768470 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768605 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768778 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.768923 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769084 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769227 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769388 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769515 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769686 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769814 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.769981 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.770119 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.770277 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.770406 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.770571 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.770708 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.771425 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.771626 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.771754 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.771883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.772041 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.772181 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.772368 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.772499 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.772679 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.772825 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773017 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773144 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773323 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773452 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773631 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773757 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.773932 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774311 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774450 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774574 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774697 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774820 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.774942 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.775127 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.775259 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.775432 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.775560 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.775740 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.775867 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776040 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776167 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776355 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776490 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776659 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776851 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.776983 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.777114 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.777281 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.777409 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.777592 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.777729 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.777926 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778054 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778243 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778371 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778558 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778697 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778868 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.778994 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.779170 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.779305 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.779478 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.779620 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.779780 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.779907 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.780086 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.780222 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.780391 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.780531 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.780696 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.780855 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781034 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781151 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781324 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781452 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781630 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781764 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.781933 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782066 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782247 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782374 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782548 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782676 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782854 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.782980 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.783149 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.783277 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.783456 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.783586 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.783777 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.783898 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.784094 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.784221 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.784424 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.784567 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.784693 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.784866 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785025 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785154 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785329 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785457 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785634 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785773 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.785937 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.786064 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.786233 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.786359 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787070 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787210 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787379 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787690 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787828 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.787994 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.788137 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.788296 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.788422 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.788598 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.788726 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.788930 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789058 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789231 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789367 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789529 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789826 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.789965 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.790130 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.790259 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.790442 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.790577 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.790744 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.790872 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791059 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791195 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791362 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791488 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791659 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791787 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.791957 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.792094 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.792272 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.792400 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.792573 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.792709 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.792899 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793030 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793195 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793335 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793494 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793632 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793832 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.793962 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.794135 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.794267 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.794464 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.794660 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.794789 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.794987 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.795124 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.795306 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.795435 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.795613 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.795741 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.795922 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.796059 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.796228 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.796357 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.796533 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.796668 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.796873 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797017 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797184 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797313 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797491 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797618 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797798 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.797936 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.798105 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.798233 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.798412 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.798550 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.798722 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.798910 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799032 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799154 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799330 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799470 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799635 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799762 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.799940 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.800075 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.800238 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.800367 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.800568 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.800837 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.800981 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.801173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.801408 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.801544 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.801738 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.801867 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.802072 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.802203 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.802387 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.802532 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.802725 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.802868 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803038 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803161 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803360 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803496 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803680 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803839 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.803976 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.804281 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.804415 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.804586 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.804925 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.805067 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.805230 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.805458 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.805587 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.805824 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.805998 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.806135 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.806423 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.806551 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.806725 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.807027 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.807154 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.807331 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.807613 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.807745 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.807942 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.808167 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.808303 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.808543 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.808740 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.808883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.809190 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.809328 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.809494 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.809632 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.809797 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.809948 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.810101 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.810259 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.810441 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.810744 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.810873 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.811078 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.811384 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.811519 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.811721 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.811908 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.812112 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.812320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.812527 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.812734 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813033 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813255 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813433 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813570 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813695 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813819 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813952 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.813952 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.814189 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.814309 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.814431 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.814537 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.814669 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.814809 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815004 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815142 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815399 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815587 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815713 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.815892 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.816029 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.816201 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.816338 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.816504 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.816777 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.816909 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.817136 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.817382 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.817530 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.817758 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.817979 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.818109 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.818488 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.818804 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.818966 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.819167 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.819396 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.819604 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.819824 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.820044 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.820254 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.820494 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.820715 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.820952 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.821185 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.821411 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.821597 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.821733 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.821858 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.821981 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822113 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822247 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822372 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822372 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822613 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822738 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822738 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.822983 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.823109 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.823241 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.823371 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.823497 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.823627 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.823761 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.824016 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.824154 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.824330 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.824452 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.824640 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.824813 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825051 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825190 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825333 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825457 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825595 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825719 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825865 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.825992 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.826165 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.826292 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.826468 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.826598 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.826765 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.826899 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827067 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827277 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827405 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827527 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827651 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827773 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.827950 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.828086 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.828249 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.828374 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.828552 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.828683 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.828878 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829057 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829197 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829471 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829600 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829768 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.829904 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.830075 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.830203 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.830393 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.830521 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.830706 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.830837 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831005 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831134 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831310 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831487 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831755 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.831881 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832003 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832183 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832311 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832487 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832624 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832806 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.832940 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.833107 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.833747 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.833926 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834066 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834227 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834355 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834526 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834655 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834843 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.834974 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.835191 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.835340 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.835466 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.835598 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.835723 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.835846 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836013 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836151 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836350 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836488 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836650 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836809 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.836990 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.837125 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.837301 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.837442 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.837612 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.837740 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.837922 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838048 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838229 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838366 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838535 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838663 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838842 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.838978 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.839147 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.839278 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.839455 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.839582 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.839757 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.839883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840063 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840200 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840362 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840489 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840660 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840845 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.840986 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.841111 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.841284 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.841413 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.841587 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.841714 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.841903 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842040 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842204 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842332 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842512 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842653 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842810 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.842936 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.843114 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.843242 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.843416 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.843551 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.843716 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.843843 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844019 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844155 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844324 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844463 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844629 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844775 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.844961 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.845126 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.845270 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.845480 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.845610 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.845734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.845864 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.846037 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.846176 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.846344 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.846481 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.846718 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.846845 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.847263 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.847406 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.847588 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.847717 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.847891 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.848027 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.848190 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.848327 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.848492 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.848621 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.848807 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.849492 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.849677 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.849823 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.849981 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.850111 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.850284 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.850411 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.850587 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.850718 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.850909 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851039 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851214 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851342 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851534 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851671 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851860 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.851987 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.852171 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.852307 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.852481 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.852617 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.852799 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.852971 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.853212 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.853342 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.853520 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.853657 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.853827 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.853949 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.854138 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.854279 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.854437 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.854573 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.854736 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.854865 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855041 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855178 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855358 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855505 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855699 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855827 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.855960 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856094 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856222 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856367 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856532 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856671 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856853 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.856996 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.857170 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.857310 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.857536 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.857670 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.857849 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.857985 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.858155 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.858291 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.858560 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.858689 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.858865 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859002 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859169 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859306 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859485 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859613 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859802 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.859930 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.860106 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.860234 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.860408 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.860543 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.860713 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.860864 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861041 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861172 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861347 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861488 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861662 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861789 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.861966 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.862096 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.862275 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.862402 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.862572 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.862708 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.862887 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863025 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863192 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863498 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863637 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863812 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.863939 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.864119 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.864246 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.864444 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.864603 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.864826 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.864959 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.865152 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.865280 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.865474 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.865622 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.865827 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.865956 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866079 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866202 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866373 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866504 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866676 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866804 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.866977 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.867104 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.867271 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.867398 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.867581 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.867708 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.867889 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868025 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868197 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868334 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868503 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868633 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868828 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.868960 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.869133 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.869264 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.869452 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.869582 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.869752 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.869890 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.870071 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.870200 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.870379 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.870508 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.870693 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.870828 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871008 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871136 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871309 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871437 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871609 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871747 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.871918 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872046 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872216 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872342 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872514 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872651 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872838 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.872967 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.873147 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.873276 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.873451 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.873582 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.873754 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.873891 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874056 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874192 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874519 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874668 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874808 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.874990 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.875119 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.875298 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.875428 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.875601 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.875728 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.875940 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876084 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876219 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876344 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876510 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876637 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876833 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.876977 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.877137 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.877267 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.877444 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.877574 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.877745 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.877884 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878045 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878174 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878345 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878477 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878649 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878786 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.878946 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879077 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879247 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879383 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879546 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879684 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879863 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.879998 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.880695 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.880888 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881025 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881141 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881335 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881470 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881636 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881765 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.881965 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.882161 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.882291 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.882489 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.882631 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.882802 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.882940 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.883112 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.883243 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.883423 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.883556 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.883733 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.883873 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884043 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884169 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884349 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884483 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884660 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884811 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.884993 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.885131 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.885301 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.885435 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.885607 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.885742 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.885918 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886125 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886253 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886392 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886527 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886661 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886813 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.886942 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.887124 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.887266 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.887475 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.887642 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.887791 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.887966 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.888147 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.888290 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.888461 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.888598 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.888800 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.888933 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.889101 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.889233 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.889418 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.889548 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.889729 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.889858 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890040 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890175 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890347 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890489 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890652 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890780 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.890960 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.891090 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.891267 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.891403 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.891575 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.891713 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.891885 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892016 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892195 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892324 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892501 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892637 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892833 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.892976 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.893144 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.893273 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.893459 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.893596 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.893773 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.893903 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.894073 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.894194 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.894382 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.894591 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.894720 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.894905 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.895034 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.895240 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.895378 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.895565 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.895694 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.896483 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.896614 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.896738 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.896911 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897045 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897170 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897306 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897432 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897612 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897743 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.897919 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.898049 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.898235 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.898366 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.898557 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.898685 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.898861 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899169 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899303 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899479 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899609 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899780 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.899907 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.900099 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.900287 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.900425 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.900595 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.900947 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.901081 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.901271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.901411 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.901590 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.901727 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.901899 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902028 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902211 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902350 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902530 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902660 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902831 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.902960 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.903131 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.903275 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.903436 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.903566 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.903742 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.903876 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904038 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904175 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904485 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904660 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904839 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.904976 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.905101 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.905283 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.905413 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.905588 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.905718 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.905891 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.906112 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.906249 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.906532 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.906677 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.906810 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.906942 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907075 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907199 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907375 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907505 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907678 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907814 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.907989 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.908118 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.908294 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.908425 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.908600 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.908730 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.908929 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909060 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909238 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909373 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909546 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909676 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909846 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.909981 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.910146 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.910275 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.910447 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.910576 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.910749 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.910876 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911049 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911184 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911414 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911547 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911671 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911795 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.911972 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.912111 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.912274 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.912402 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.912591 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.912724 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.912896 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913041 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913168 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913291 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913467 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913596 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913768 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.913906 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914069 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914199 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914369 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914496 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914680 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914823 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.914979 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.915281 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.915409 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.915576 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.915713 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.915880 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.916010 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.916227 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.916356 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.916531 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.916749 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.916919 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917045 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917169 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917292 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917428 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917567 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917729 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.917860 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918039 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918167 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918344 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918475 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918657 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918784 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.918964 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.919104 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.919270 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.919400 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.919579 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.919706 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.919887 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.920017 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.920196 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.920419 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.920548 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.920780 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.920924 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.921094 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.921233 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.921411 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.921546 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.921720 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.921856 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922027 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922157 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922329 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922457 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922634 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922764 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.922955 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.923094 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.923261 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.923390 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.923570 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.923704 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.923876 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924006 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924181 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924310 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924490 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924626 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924815 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.924956 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.925122 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.925252 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.925429 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.925566 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.925735 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.925864 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.926038 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.926167 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.926341 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.926479 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.926645 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.926948 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.927101 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.927272 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.927411 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.927580 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.927709 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.927912 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928041 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928225 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928393 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928521 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928645 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928856 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.928999 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.929159 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.929300 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.929462 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.929591 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.929768 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.929897 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.930071 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.930208 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.930375 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.930504 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.930683 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.930811 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931007 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931139 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931316 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931447 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931617 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931754 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.931979 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.932277 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.932412 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.932588 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.932717 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.932922 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933063 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933232 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933361 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933538 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933674 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933846 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.933993 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.934151 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.934279 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.934455 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.934577 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.934760 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.934891 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935065 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935193 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935376 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935504 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935680 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935803 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.935983 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.936119 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.936286 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.936424 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.936591 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.936721 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.936994 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937123 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937248 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937385 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937511 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937634 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937796 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.937925 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.938100 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.938236 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.938402 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.938529 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.938701 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.938829 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939002 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939138 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939300 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939426 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939600 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939727 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.939925 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940053 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940176 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940299 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940474 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940602 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940785 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.940920 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.941090 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.941218 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.941388 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.941516 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.941794 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.941923 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.942054 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.942178 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.942301 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.942423 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.942559 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.943304 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.943441 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.943565 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.943689 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.943870 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944000 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944185 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944322 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944493 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944619 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944821 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.944951 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.945134 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.945262 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.945461 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.945589 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.945773 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.945896 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.946075 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.946204 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.946392 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.946538 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.946698 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.946826 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947034 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947182 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947309 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947441 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947621 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947749 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.947923 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.948049 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.948248 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.948385 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.948552 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.948679 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.948881 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949011 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949189 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949330 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949493 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949628 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949797 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.949925 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.950100 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.950237 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.950408 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.950534 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.950714 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.950841 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951013 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951142 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951334 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951462 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951644 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951773 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.951957 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.952093 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.952265 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.952393 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.952572 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.952710 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.952925 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.953040 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.955686 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.955838 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.955952 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956075 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956187 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956294 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956409 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956524 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956639 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956795 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.956924 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957033 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957033 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.957336 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.958106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.958106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.958106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.959052 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.959254 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.959564 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.959874 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.960175 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:15:36.960413 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:15:37.107642 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Registered counter for database nova_api Sep 15 12:15:37.112704 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-32215937-173b-408c-b484-047a5f316f7f None None] Registered counter for database nova_api Sep 15 12:15:37.127600 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.132567 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-32215937-173b-408c-b484-047a5f316f7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.135953 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.138928 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.193631 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.context [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6933a6ed-ec74-4c8d-8925-fcb2307d9c1c(cell1) {{(pid=105459) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:15:37.195272 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.context [None req-32215937-173b-408c-b484-047a5f316f7f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6933a6ed-ec74-4c8d-8925-fcb2307d9c1c(cell1) {{(pid=105460) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:15:37.197470 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:15:37.197951 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:15:37.199115 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-32215937-173b-408c-b484-047a5f316f7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:15:37.199495 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:15:37.199595 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-32215937-173b-408c-b484-047a5f316f7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:15:37.200223 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:15:37.200672 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:15:37.201119 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-32215937-173b-408c-b484-047a5f316f7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:15:37.201827 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-32215937-173b-408c-b484-047a5f316f7f None None] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:15:37.202265 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-32215937-173b-408c-b484-047a5f316f7f None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:15:37.202679 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_concurrency.lockutils [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:15:37.204222 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-32215937-173b-408c-b484-047a5f316f7f None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:15:37.204662 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Registered counter for database nova_cell0 Sep 15 12:15:37.206195 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-32215937-173b-408c-b484-047a5f316f7f None None] Registered counter for database nova_cell0 Sep 15 12:15:37.208861 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Registered counter for database nova_cell1 Sep 15 12:15:37.210130 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-32215937-173b-408c-b484-047a5f316f7f None None] Registered counter for database nova_cell1 Sep 15 12:15:37.216832 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.218460 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.219928 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-32215937-173b-408c-b484-047a5f316f7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.221850 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-32215937-173b-408c-b484-047a5f316f7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.225640 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.227084 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.227997 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.233208 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.370857 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO dbcounter [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Registered counter for database nova_cell0 Sep 15 12:15:37.374596 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-32215937-173b-408c-b484-047a5f316f7f None None] Registered counter for database nova_cell0 Sep 15 12:15:37.378173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG oslo_db.sqlalchemy.engines [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.382537 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writer thread running {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.383044 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-32215937-173b-408c-b484-047a5f316f7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:15:37.387639 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:15:37.721023 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-32215937-173b-408c-b484-047a5f316f7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:15:37.725469 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:15:37.728575 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-32215937-173b-408c-b484-047a5f316f7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:15:37.732636 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:15:38.069306 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-32215937-173b-408c-b484-047a5f316f7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:15:38.072387 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:15:38.075211 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-32215937-173b-408c-b484-047a5f316f7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:15:38.078323 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: WARNING keystonemiddleware.auth_token [None req-743acb36-d19c-473a-8b3e-ed9f70ab81c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:15:38.080449 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b0840f9c0 pid: 105460 (default app) Sep 15 12:15:38.082711 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-32215937-173b-408c-b484-047a5f316f7f None None] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:15:38.083917 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-32215937-173b-408c-b484-047a5f316f7f None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001916 Sep 15 12:15:38.084326 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Thu Sep 15 12:15:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:15:38.084663 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b0840f9c0 pid: 105459 (default app) Sep 15 12:16:59.018764 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-32215937-173b-408c-b484-047a5f316f7f None None] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:16:59.020431 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-32215937-173b-408c-b484-047a5f316f7f None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Sep 15 12:16:59.021093 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:16:59.038456 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:59.039550 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_cell1:SELECT=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:59.040559 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_cell0:SELECT=3 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:59.041416 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:59.915848 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0240f5e9-2f8a-44f1-be6b-ac1b9a536962 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:16:59.946958 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0240f5e9-2f8a-44f1-be6b-ac1b9a536962 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918866 Sep 15 12:16:59.947861 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 12:16:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:17:02.540234 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-32215937-173b-408c-b484-047a5f316f7f None None] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:02.541272 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-32215937-173b-408c-b484-047a5f316f7f None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 15 12:17:02.541953 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:03.006184 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-1cf02e68-a11b-4a30-afc5-58a025e5dafc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:03.053493 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-1cf02e68-a11b-4a30-afc5-58a025e5dafc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505307 Sep 15 12:17:03.053886 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:17:03.067238 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=3 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:03.069304 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell0:SELECT=3 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:03.070308 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell1:SELECT=3 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:03.071286 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:03.276356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-530c3fbf-6036-4ffa-8a44-5a61db62fd42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:03.345367 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-530c3fbf-6036-4ffa-8a44-5a61db62fd42 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283159 Sep 15 12:17:03.346498 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 12:17:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:05.917397 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-1cf02e68-a11b-4a30-afc5-58a025e5dafc admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:05.918302 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-1cf02e68-a11b-4a30-afc5-58a025e5dafc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 15 12:17:05.918865 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:06.555695 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ff17213e-1ddc-4e4b-9098-2edc70adff16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:06.597750 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-ff17213e-1ddc-4e4b-9098-2edc70adff16 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.672568 Sep 15 12:17:06.598582 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:06.612717 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-4d160bf8-da01-4381-bced-e261dae9169c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:06.656662 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-4d160bf8-da01-4381-bced-e261dae9169c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049627 Sep 15 12:17:06.657392 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 12:17:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:09.280493 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ff17213e-1ddc-4e4b-9098-2edc70adff16 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:09.281582 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-ff17213e-1ddc-4e4b-9098-2edc70adff16 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Sep 15 12:17:09.282028 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:09.696741 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-3b815c6f-72c2-41f2-9794-b66c9d7f009b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:09.715794 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-3b815c6f-72c2-41f2-9794-b66c9d7f009b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427119 Sep 15 12:17:09.716467 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:09.729194 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-49647d9e-fc6e-443d-9bc8-a6f19c1a5978 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:09.757658 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-49647d9e-fc6e-443d-9bc8-a6f19c1a5978 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032315 Sep 15 12:17:09.758241 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 12:17:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:17:12.423015 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-3b815c6f-72c2-41f2-9794-b66c9d7f009b admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:12.423931 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-3b815c6f-72c2-41f2-9794-b66c9d7f009b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 15 12:17:12.424327 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:12.839119 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-d258cf12-8813-4166-bcb5-ab6958cf7df2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:12.859391 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-d258cf12-8813-4166-bcb5-ab6958cf7df2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428759 Sep 15 12:17:12.860023 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:12.872000 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-7fff99aa-5a68-41eb-b1ba-8595ca5c6b7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:12.904572 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-7fff99aa-5a68-41eb-b1ba-8595ca5c6b7a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036005 Sep 15 12:17:12.905185 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 12:17:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:17:15.530744 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-d258cf12-8813-4166-bcb5-ab6958cf7df2 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:15.531670 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-d258cf12-8813-4166-bcb5-ab6958cf7df2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 15 12:17:15.532071 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:15.972430 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-64488921-be86-437c-9c97-a4921e6b18a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:15.998734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-64488921-be86-437c-9c97-a4921e6b18a5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458898 Sep 15 12:17:15.999841 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:16.012226 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-37c2436c-8fd2-4ac7-8e14-8f7079b068f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:16.038170 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-37c2436c-8fd2-4ac7-8e14-8f7079b068f1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029669 Sep 15 12:17:16.038763 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 12:17:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:18.634319 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-64488921-be86-437c-9c97-a4921e6b18a5 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:18.635475 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-64488921-be86-437c-9c97-a4921e6b18a5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Sep 15 12:17:18.635954 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:19.067117 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-de67c508-88cb-4ffc-9f8d-f9c5d20bd407 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:19.092203 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-de67c508-88cb-4ffc-9f8d-f9c5d20bd407 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447351 Sep 15 12:17:19.093064 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 12:17:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:17:21.751906 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-64488921-be86-437c-9c97-a4921e6b18a5 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:21.752973 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-64488921-be86-437c-9c97-a4921e6b18a5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 15 12:17:21.753404 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:22.205620 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-e22b98eb-296e-42ae-93fd-9aaea75ebeb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:22.227123 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-e22b98eb-296e-42ae-93fd-9aaea75ebeb6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467501 Sep 15 12:17:22.227652 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:22.240343 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-92455c00-5ad1-48aa-985b-2abd0b5173c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:22.268020 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-92455c00-5ad1-48aa-985b-2abd0b5173c5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031349 Sep 15 12:17:22.268884 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 12:17:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:24.936027 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-e22b98eb-296e-42ae-93fd-9aaea75ebeb6 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:24.937068 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-e22b98eb-296e-42ae-93fd-9aaea75ebeb6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 15 12:17:24.941101 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:25.313417 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-aad75ee9-7b50-447e-bff4-9354d4faa647 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:25.332509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-aad75ee9-7b50-447e-bff4-9354d4faa647 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.388761 Sep 15 12:17:25.333098 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:17:25.345774 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-4e7d963d-56ff-4108-ad80-13588ce8c468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:25.382473 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-4e7d963d-56ff-4108-ad80-13588ce8c468 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041070 Sep 15 12:17:25.383268 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 12:17:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:28.036097 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-aad75ee9-7b50-447e-bff4-9354d4faa647 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:28.037645 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-aad75ee9-7b50-447e-bff4-9354d4faa647 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Sep 15 12:17:28.038445 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:28.514027 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ea0ed4e0-d098-49e6-b657-c85ef65d0e17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:28.533750 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-ea0ed4e0-d098-49e6-b657-c85ef65d0e17 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.486079 Sep 15 12:17:28.536810 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:28.546296 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-383c1429-7db9-4551-9543-7ee907b4cb7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:28.577954 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-383c1429-7db9-4551-9543-7ee907b4cb7c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035219 Sep 15 12:17:28.578824 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 12:17:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:31.221534 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ea0ed4e0-d098-49e6-b657-c85ef65d0e17 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:31.223156 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-ea0ed4e0-d098-49e6-b657-c85ef65d0e17 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Sep 15 12:17:31.227301 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:31.655519 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-12920995-5689-46b4-879d-3d25f627400e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:31.663554 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:31.687388 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-12920995-5689-46b4-879d-3d25f627400e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457534 Sep 15 12:17:31.689302 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:31.700326 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-82ce0681-314a-40a6-b537-973df52b3f1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:31.727106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-82ce0681-314a-40a6-b537-973df52b3f1d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030582 Sep 15 12:17:31.728234 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 12:17:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:34.359885 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-12920995-5689-46b4-879d-3d25f627400e admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:34.360929 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-12920995-5689-46b4-879d-3d25f627400e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 15 12:17:34.364783 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:34.813999 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-4822ce8d-ddb0-4291-bfb0-02c3cb7653c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:34.821807 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:34.837409 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-4822ce8d-ddb0-4291-bfb0-02c3cb7653c1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470109 Sep 15 12:17:34.837972 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 12:17:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:17:34.850759 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-ef0bc6b2-fc3d-4066-a54b-ffdecb385339 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:17:34.878508 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-ef0bc6b2-fc3d-4066-a54b-ffdecb385339 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031350 Sep 15 12:17:34.879075 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 12:17:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:17:52.828274 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-4822ce8d-ddb0-4291-bfb0-02c3cb7653c1 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:52.829329 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-4822ce8d-ddb0-4291-bfb0-02c3cb7653c1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Sep 15 12:17:52.829722 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:52.841885 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:53.224982 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-46ce37d0-e479-423f-908a-f0c513aab108 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:53.243386 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-46ce37d0-e479-423f-908a-f0c513aab108 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406022 Sep 15 12:17:53.243915 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 12:17:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:17:54.532971 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-4822ce8d-ddb0-4291-bfb0-02c3cb7653c1 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:54.533963 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-4822ce8d-ddb0-4291-bfb0-02c3cb7653c1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 15 12:17:54.534352 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:55.064794 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-221cf26c-a0a0-41df-ae6b-142bb562792c admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:55.073031 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.wsgi [None req-221cf26c-a0a0-41df-ae6b-142bb562792c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-221cf26c-a0a0-41df-ae6b-142bb562792c admin admin] Request method failure captured: Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Accept: application/json Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Accept-Encoding: gzip, deflate Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Connection: keep-alive Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Content-Length: 0 Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Host: 10.222.0.15 Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Openstack-Api-Version: compute 2.92 Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Openstack-System-Scope: None Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: User-Agent: python-novaclient Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Auth-Token: gAAAAABjIxfy3YWE7TCETt-vwQBeYwpjeLAHNF6VfbLalkg696BraYKnTKVPy1797OlgL_BcLzq6mh3BR9W_b8z_nq6RTvy9pMvGH5H2UyZjH0lptbB21ehRV26s0AMcRvmYMlvqFqilAL77mXEui6G9XV5kfEDzuDZA1FE2yNTmaes-g0XQkFQ Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Domain-Id: None Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Domain-Name: None Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Identity-Status: Confirmed Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Is-Admin-Project: True Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Domain-Id: default Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Domain-Name: Default Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Name: admin Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Role: reader,admin,member Sep 15 12:17:55.076509 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Roles: reader,admin,member Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69bea7b802b04b689af0d31b020f8554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant: admin Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant-Name: admin Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User: admin Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Domain-Id: default Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Domain-Name: Default Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Id: c66eff9fe7124011868989f16846a501 Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Name: admin Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: method: > Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: exception: Flavor 42 could not be found. Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: action_args: {'id': '42'} Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:17:55.078163 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:55.079228 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.080639 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-221cf26c-a0a0-41df-ae6b-142bb562792c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:17:55.081921 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-221cf26c-a0a0-41df-ae6b-142bb562792c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.404564 Sep 15 12:17:55.081921 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 12:17:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:55.088069 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-fee41eb4-16ab-4d5f-8ff3-36bb9991e808 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:55.111993 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-fee41eb4-16ab-4d5f-8ff3-36bb9991e808 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027735 Sep 15 12:17:55.112531 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 12:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:17:55.122989 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-525159b1-9af0-41b3-8156-6806c983029f admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:55.144145 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-525159b1-9af0-41b3-8156-6806c983029f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025583 Sep 15 12:17:55.144654 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 12:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:17:55.154234 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-59e40a46-9a34-4e71-bffe-be62aea3e2d1 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:55.159547 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.wsgi [None req-59e40a46-9a34-4e71-bffe-be62aea3e2d1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-59e40a46-9a34-4e71-bffe-be62aea3e2d1 admin admin] Request method failure captured: Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Accept: application/json Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Accept-Encoding: gzip, deflate Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Connection: keep-alive Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Content-Length: 0 Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Host: 10.222.0.15 Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Openstack-Api-Version: compute 2.92 Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Openstack-System-Scope: None Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: User-Agent: python-novaclient Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Auth-Token: gAAAAABjIxfy3YWE7TCETt-vwQBeYwpjeLAHNF6VfbLalkg696BraYKnTKVPy1797OlgL_BcLzq6mh3BR9W_b8z_nq6RTvy9pMvGH5H2UyZjH0lptbB21ehRV26s0AMcRvmYMlvqFqilAL77mXEui6G9XV5kfEDzuDZA1FE2yNTmaes-g0XQkFQ Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Domain-Id: None Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Domain-Name: None Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Identity-Status: Confirmed Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Is-Admin-Project: True Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Domain-Id: default Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Domain-Name: Default Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Name: admin Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Role: reader,admin,member Sep 15 12:17:55.162870 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Roles: reader,admin,member Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69bea7b802b04b689af0d31b020f8554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant: admin Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant-Name: admin Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User: admin Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Domain-Id: default Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Domain-Name: Default Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Id: c66eff9fe7124011868989f16846a501 Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Name: admin Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: method: > Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: exception: Flavor 42 could not be found. Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: action_args: {'id': '42'} Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:17:55.164356 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:55.165266 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:55.166320 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-59e40a46-9a34-4e71-bffe-be62aea3e2d1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:17:55.167352 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-59e40a46-9a34-4e71-bffe-be62aea3e2d1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013981 Sep 15 12:17:55.167352 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 12:17:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 12:17:56.371746 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-525159b1-9af0-41b3-8156-6806c983029f admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:56.373306 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-525159b1-9af0-41b3-8156-6806c983029f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Sep 15 12:17:56.373759 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:56.888144 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-b6fa7b7b-abde-4035-af0f-22ae18f1f2e2 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:56.893131 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.wsgi [None req-b6fa7b7b-abde-4035-af0f-22ae18f1f2e2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-b6fa7b7b-abde-4035-af0f-22ae18f1f2e2 admin admin] Request method failure captured: Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Accept: application/json Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Accept-Encoding: gzip, deflate Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Connection: keep-alive Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Content-Length: 0 Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Host: 10.222.0.15 Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Openstack-Api-Version: compute 2.92 Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Openstack-System-Scope: None Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: User-Agent: python-novaclient Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Auth-Token: gAAAAABjIxf0-ddl0-wRVNyp8ffSWTSM7Vrnf1hUjc1Sq0ixbYZi9VVxQb58RwoUOWnafBhrQYOwzXrptRII3r3Z30OKKqByFOE1F0BQfIY8I1QBCQP2GpRlw11mVvzFFAishQStj_Jl1ARYYa5rrZmsO4nSJECdbhkHBdaJl8P0DrJK-71T67M Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Domain-Id: None Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Domain-Name: None Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Identity-Status: Confirmed Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Is-Admin-Project: True Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Domain-Id: default Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Domain-Name: Default Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Name: admin Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Role: reader,admin,member Sep 15 12:17:56.894623 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Roles: reader,admin,member Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69bea7b802b04b689af0d31b020f8554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant: admin Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant-Name: admin Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User: admin Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Domain-Id: default Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Domain-Name: Default Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Id: c66eff9fe7124011868989f16846a501 Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Name: admin Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: method: > Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: exception: Flavor 84 could not be found. Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: action_args: {'id': '84'} Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:17:56.896106 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:56.897006 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.898271 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-b6fa7b7b-abde-4035-af0f-22ae18f1f2e2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:17:56.899333 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-b6fa7b7b-abde-4035-af0f-22ae18f1f2e2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386110 Sep 15 12:17:56.899333 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 12:17:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:56.905632 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-916c0a3a-be30-4797-9143-025986863483 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:56.920671 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-916c0a3a-be30-4797-9143-025986863483 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018591 Sep 15 12:17:56.921222 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 12:17:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:17:56.932164 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-32b894b9-387f-4748-a59b-0eb367c85e66 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:56.947915 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-32b894b9-387f-4748-a59b-0eb367c85e66 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019343 Sep 15 12:17:56.948439 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 12:17:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:17:56.957884 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-e75ec043-b6a1-4985-8d04-60479f9c34c4 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:56.962891 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.wsgi [None req-e75ec043-b6a1-4985-8d04-60479f9c34c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-e75ec043-b6a1-4985-8d04-60479f9c34c4 admin admin] Request method failure captured: Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Accept: application/json Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Accept-Encoding: gzip, deflate Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Connection: keep-alive Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Content-Length: 0 Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Host: 10.222.0.15 Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Openstack-Api-Version: compute 2.92 Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Openstack-System-Scope: None Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: User-Agent: python-novaclient Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Auth-Token: gAAAAABjIxf0-ddl0-wRVNyp8ffSWTSM7Vrnf1hUjc1Sq0ixbYZi9VVxQb58RwoUOWnafBhrQYOwzXrptRII3r3Z30OKKqByFOE1F0BQfIY8I1QBCQP2GpRlw11mVvzFFAishQStj_Jl1ARYYa5rrZmsO4nSJECdbhkHBdaJl8P0DrJK-71T67M Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Domain-Id: None Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Domain-Name: None Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Identity-Status: Confirmed Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Is-Admin-Project: True Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Domain-Id: default Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Domain-Name: Default Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Name: admin Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Role: reader,admin,member Sep 15 12:17:56.964391 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Roles: reader,admin,member Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69bea7b802b04b689af0d31b020f8554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant: admin Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant-Name: admin Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User: admin Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Domain-Id: default Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Domain-Name: Default Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Id: c66eff9fe7124011868989f16846a501 Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Name: admin Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: method: > Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: exception: Flavor 84 could not be found. Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: action_args: {'id': '84'} Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:17:56.966051 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:56.967013 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:56.968288 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-e75ec043-b6a1-4985-8d04-60479f9c34c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:17:56.969815 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-e75ec043-b6a1-4985-8d04-60479f9c34c4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011463 Sep 15 12:17:56.969815 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 12:17:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:58.291599 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-32b894b9-387f-4748-a59b-0eb367c85e66 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:58.292598 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-32b894b9-387f-4748-a59b-0eb367c85e66 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 15 12:17:58.293015 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:17:58.816963 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5b85e430-6511-4742-8840-eea64802bae7 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:58.822660 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.wsgi [None req-5b85e430-6511-4742-8840-eea64802bae7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5b85e430-6511-4742-8840-eea64802bae7 admin admin] Request method failure captured: Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Accept: application/json Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Accept-Encoding: gzip, deflate Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Connection: keep-alive Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Content-Length: 0 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Host: 10.222.0.15 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Openstack-Api-Version: compute 2.92 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Openstack-System-Scope: None Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: User-Agent: python-novaclient Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Auth-Token: gAAAAABjIxf2Xm_aO2YNDdASpC66_JKj6WP7gsXQiyYF2WQ8AOKsEr4_VckVKY9QeRJPK5UTtCHLtc7rAGTX8Ked8aPNuFi-EnRE8vLSyt1OfHRMPco1fr5KAf2RTYxP7vMoHTqCo2PgvSEZtFRazBVzNU0GKD0DggRiYQx7IOuEVMSrbdMCaI0 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Domain-Id: None Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Domain-Name: None Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Identity-Status: Confirmed Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Is-Admin-Project: True Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Domain-Id: default Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Domain-Name: Default Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Project-Name: admin Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Role: reader,admin,member Sep 15 12:17:58.824173 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Roles: reader,admin,member Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69bea7b802b04b689af0d31b020f8554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant: admin Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-Tenant-Name: admin Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User: admin Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Domain-Id: default Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Domain-Name: Default Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Id: c66eff9fe7124011868989f16846a501 Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: X-User-Name: admin Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: method: > Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: exception: Flavor 451 could not be found. Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: action_args: {'id': '451'} Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:17:58.825734 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:58.827658 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.828883 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-5b85e430-6511-4742-8840-eea64802bae7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:17:58.829895 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-5b85e430-6511-4742-8840-eea64802bae7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392159 Sep 15 12:17:58.829895 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 12:17:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:58.835225 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-7df241fb-cadc-497a-8d8f-1b7f187bb495 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:58.850796 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-7df241fb-cadc-497a-8d8f-1b7f187bb495 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019042 Sep 15 12:17:58.851365 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 12:17:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:17:58.864062 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:58.878722 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020224 Sep 15 12:17:58.879249 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 12:17:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:17:58.890776 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cac11aa1-6803-4ddc-ace2-905b288ff73a admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:17:58.899045 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.wsgi [None req-cac11aa1-6803-4ddc-ace2-905b288ff73a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cac11aa1-6803-4ddc-ace2-905b288ff73a admin admin] Request method failure captured: Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Accept: application/json Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Accept-Encoding: gzip, deflate Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Connection: keep-alive Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Content-Length: 0 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Host: 10.222.0.15 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Openstack-Api-Version: compute 2.92 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Openstack-System-Scope: None Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: User-Agent: python-novaclient Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Auth-Token: gAAAAABjIxf2Xm_aO2YNDdASpC66_JKj6WP7gsXQiyYF2WQ8AOKsEr4_VckVKY9QeRJPK5UTtCHLtc7rAGTX8Ked8aPNuFi-EnRE8vLSyt1OfHRMPco1fr5KAf2RTYxP7vMoHTqCo2PgvSEZtFRazBVzNU0GKD0DggRiYQx7IOuEVMSrbdMCaI0 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Domain-Id: None Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Domain-Name: None Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Identity-Status: Confirmed Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Is-Admin-Project: True Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Domain-Id: default Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Domain-Name: Default Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Project-Name: admin Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Role: reader,admin,member Sep 15 12:17:58.900927 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Roles: reader,admin,member Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69bea7b802b04b689af0d31b020f8554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69bea7b802b04b689af0d31b020f8554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant: admin Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant-Id: 69bea7b802b04b689af0d31b020f8554 Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-Tenant-Name: admin Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User: admin Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Domain-Id: default Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Domain-Name: Default Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Id: c66eff9fe7124011868989f16846a501 Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: X-User-Name: admin Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: method: > Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: exception: Flavor 451 could not be found. Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: action_args: {'id': '451'} Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:17:58.902594 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:58.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 15 12:17:58.906440 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cac11aa1-6803-4ddc-ace2-905b288ff73a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:17:58.907579 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-cac11aa1-6803-4ddc-ace2-905b288ff73a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.017225 Sep 15 12:17:58.907579 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 12:17:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:00.118718 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:18:00.119711 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 15 12:18:00.120092 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:18:00.645388 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-2ba50821-f227-4106-baf9-181a61e766f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:18:00.663834 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-2ba50821-f227-4106-baf9-181a61e766f5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403629 Sep 15 12:18:00.664365 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 12:18:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:18:01.881714 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:18:01.882745 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 15 12:18:01.883170 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:18:02.402982 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-4691b016-4697-4d79-8eaa-fb2b167f5da1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:18:02.421822 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-4691b016-4697-4d79-8eaa-fb2b167f5da1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401009 Sep 15 12:18:02.422363 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 12:18:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:18:03.629014 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:18:03.630016 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 15 12:18:03.630405 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:18:04.142897 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-41cf326d-24c5-498f-978c-ce9aaadfb480 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:18:04.162055 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-41cf326d-24c5-498f-978c-ce9aaadfb480 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.394018 Sep 15 12:18:04.162624 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 12:18:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:18:05.367951 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:18:05.368989 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 15 12:18:05.369385 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:18:05.884939 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-07f49c9c-ed90-4ee8-a843-85b291b4ab7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:18:05.903543 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-07f49c9c-ed90-4ee8-a843-85b291b4ab7e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398649 Sep 15 12:18:05.904109 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 12:18:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:18:07.124207 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:18:07.125243 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 15 12:18:07.125635 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:18:07.637790 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-e07e9923-f6e9-4df1-99d4-9e3b32290a64 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:18:07.658489 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-e07e9923-f6e9-4df1-99d4-9e3b32290a64 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396516 Sep 15 12:18:07.659020 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Thu Sep 15 12:18:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:19:05.427330 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:19:05.428340 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-95e7043a-b0e9-4807-9703-579b742fb352 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 15 12:19:05.428741 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 12:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:19:05.439658 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:05.818314 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-083a136d-f610-4dd5-9979-e63d41fae150 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:19:05.838741 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-083a136d-f610-4dd5-9979-e63d41fae150 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403663 Sep 15 12:19:05.838894 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 12:19:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:19:05.860703 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=14 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:05.864415 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-8cd4b4aa-3513-42c3-92ca-d4aa9b1ea359 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:19:05.871817 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-8cd4b4aa-3513-42c3-92ca-d4aa9b1ea359 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012653 Sep 15 12:19:05.872335 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Sep 15 12:19:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:19:05.883664 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-2b886450-a6b1-4914-be5a-d868da689c59 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:19:05.890774 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-2b886450-a6b1-4914-be5a-d868da689c59 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010644 Sep 15 12:19:05.891277 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Sep 15 12:19:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:19:05.902183 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:19:05.909703 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011026 Sep 15 12:19:05.910201 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Sep 15 12:19:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:19:05.921629 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-856fd7b2-6e36-4854-86c7-d39e7b9250c6 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:19:05.928575 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-856fd7b2-6e36-4854-86c7-d39e7b9250c6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010866 Sep 15 12:19:05.929053 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Sep 15 12:19:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:22:09.991728 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:09.992747 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 15 12:22:09.993264 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:22:10.137998 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=6 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:10.302640 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:10.307312 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:10.307788 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:10.308214 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:10.308969 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:10.309420 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:10.309839 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:10.341080 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-350e5464-f2c1-4373-a957-4b5d628f0b0a admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204343 Sep 15 12:22:10.341626 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 12:22:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:22:11.417059 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:11.418059 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 15 12:22:11.418454 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:22:11.612823 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:11.616147 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:11.616617 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:11.617068 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:11.617790 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:11.618201 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:11.618612 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:11.638116 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-b2121dbc-33ef-436f-bd35-5fc5335b370a admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077706 Sep 15 12:22:11.638674 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 12:22:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:22:23.134622 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:23.135644 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 15 12:22:23.136026 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:22:23.277713 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell0:SELECT=4 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:23.278346 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell1:SELECT=4 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:23.278956 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=8 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:23.325013 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:23.328899 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:23.329374 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:23.329801 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:23.330512 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:23.330957 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:23.331374 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:23.356703 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-b253c7f7-c828-41b2-9e38-c225c1097315 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083507 Sep 15 12:22:23.357270 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 12:22:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:22:24.433259 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG nova.api.openstack.wsgi [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] Calling method '>' {{(pid=105459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:24.434251 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: INFO nova.api.openstack.requestlog [None req-0b38e153-4cac-412f-9c98-e4d4104b7b26 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 15 12:22:24.434688 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: [pid: 105459|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 12:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:22:24.625416 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:22:24.628780 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:24.629256 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:24.629680 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:24.630390 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:22:24.630832 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:22:24.631246 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:22:24.652684 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-34efceb1-3361-4336-9802-fc1048e986d3 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078802 Sep 15 12:22:24.653219 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 12:22:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:23:23.981351 dv-cinder-850836-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 12:23:23.981854 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: Thu Sep 15 12:23:23 2022 - graceful shutdown triggered... Sep 15 12:23:23.982290 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: Gracefully killing worker 1 (pid: 105459)... Sep 15 12:23:23.982660 dv-cinder-850836-7-iscsi devstack@n-api.service[105460]: Gracefully killing worker 2 (pid: 105460)... Sep 15 12:23:24.106923 dv-cinder-850836-7-iscsi devstack@n-api.service[105459]: DEBUG dbcounter [-] [105459] Writing DB stats nova_api:SELECT=4 {{(pid=105459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:23:24.982800 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: worker 1 buried after 1 seconds Sep 15 12:23:24.983213 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: worker 2 buried after 1 seconds Sep 15 12:23:24.983213 dv-cinder-850836-7-iscsi devstack@n-api.service[105458]: goodbye to uWSGI. Sep 15 12:23:24.984413 dv-cinder-850836-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 12:23:24.984986 dv-cinder-850836-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 12:23:24.987772 dv-cinder-850836-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 12:23:25.003337 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 12:23:25 2022] *** Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: nodename: dv-cinder-850836-7-iscsi Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: machine: x86_64 Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: clock source: unix Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: pcre jit disabled Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: detected number of CPU cores: 4 Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: current working directory: / Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: detected binary path: /usr/bin/uwsgi-core Sep 15 12:23:25.006040 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: your processes number limit is 47680 Sep 15 12:23:25.006967 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: your memory page size is 4096 bytes Sep 15 12:23:25.006967 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: detected max file descriptor number: 2048 Sep 15 12:23:25.006967 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: lock engine: pthread robust mutexes Sep 15 12:23:25.006967 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: thunder lock: enabled Sep 15 12:23:25.006967 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 12:23:25.006967 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 12:23:25.048064 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: Python main interpreter initialized at 0x5622d689e9c0 Sep 15 12:23:25.048064 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: python threads support enabled Sep 15 12:23:25.048064 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: your server socket listen backlog is limited to 100 connections Sep 15 12:23:25.048064 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: your mercy for graceful operations on workers is 90 seconds Sep 15 12:23:25.048519 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 12:23:25.048519 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: *** Operational MODE: preforking *** Sep 15 12:23:25.048796 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: *** uWSGI is running in multiple interpreter mode *** Sep 15 12:23:25.048796 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: spawned uWSGI master process (pid: 120419) Sep 15 12:23:25.049004 dv-cinder-850836-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 12:23:25.049585 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: spawned uWSGI worker 1 (pid: 120436, cores: 1) Sep 15 12:23:25.050135 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: spawned uWSGI worker 2 (pid: 120437, cores: 1) Sep 15 12:23:25.050477 dv-cinder-850836-7-iscsi devstack@n-api.service[120419]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 12:23:25.704357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:23:25.705252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 12:23:26.868834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:23:26.868834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: from cryptography.utils import int_from_bytes Sep 15 12:23:26.869432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:23:26.869432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: from cryptography.utils import int_from_bytes Sep 15 12:23:26.893453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:23:26.893453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: from cryptography.utils import int_from_bytes Sep 15 12:23:26.894045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:23:26.894045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: from cryptography.utils import int_from_bytes Sep 15 12:23:29.307458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:23:29.308074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:23:29.308422 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:23:29.308847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:23:29.309180 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:23:29.309648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.310029 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.310401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.310730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.311141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.311550 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.311960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.312332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.312726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.313078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.313423 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.313973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-7-iscsi {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.314387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.314781 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.315137 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.315562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.315949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.316322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.316697 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.317330 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.318727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.318727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.318727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.319129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.319362 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.319682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.320014 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.320328 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.320646 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.320992 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.321376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-7-iscsi {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.321701 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.322024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.322326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.322750 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.323078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.323309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:23:29.323743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.323825 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:23:29.323927 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.324149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:23:29.324275 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.324479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.324600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:23:29.324686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:23:29.324914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.325150 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.325278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.325481 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.325708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.325889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.326063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.326223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.326373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.326574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.326720 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.326871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.327039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.327221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.327413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.327561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.327736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.327901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.328088 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.328232 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.328373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.328567 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.328734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.328917 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-7-iscsi {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.329069 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.329218 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.329394 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.329551 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.329708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.329886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330083 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330238 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330551 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.330999 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.331141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.331671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.331898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.332069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.332225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.332376 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.332526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.332694 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.332896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.333942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.334083 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.334224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.334372 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.334523 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.334685 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.335110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-7-iscsi {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.335279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.335430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.335582 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.335725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.335882 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336025 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336165 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336314 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336470 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.336952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.337102 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.337252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.337451 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.337602 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.337819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.337970 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.338145 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.338309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.338473 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.338622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.338847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.339006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.339243 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.339400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.339631 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.339786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.339929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.340071 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.340220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.340907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.341073 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.341252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.341410 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.341582 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342004 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342170 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.342981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.343126 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.343277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.343427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.343572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.343720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.343883 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.344025 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.344168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.344316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.344467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.344618 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.344798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.345366 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.345518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.345661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.345889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.346053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.346219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.346369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.346514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.346656 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.347057 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.347218 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.347369 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.347558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.347711 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.347863 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348006 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348619 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348825 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.348988 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.349131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.349325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.349472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.349633 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.349858 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350165 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350624 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.350917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.351067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.351216 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.351372 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.351529 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.351677 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.351677 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.352234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.352377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.352540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.352700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.352891 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353043 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353327 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.353917 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354067 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354218 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354361 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354806 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.354956 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.355129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.355129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.355716 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.355860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.356001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.356787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.356958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.357109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.357252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.357401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.357730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.357892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358484 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.358931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.359081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.359223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.359377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.359519 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.359519 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.359840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.360102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.360253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.360402 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.360546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.360702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.360952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.361098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.361248 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.361397 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.361546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.361723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.361723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.362413 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.362579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.362731 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.362880 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.363034 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.363179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.363330 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.363510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.363664 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.363844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.363989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.364152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.364306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.364457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.364608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.364766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.364928 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.365078 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.365234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.365403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.365403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.366021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.366172 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.366326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.366481 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.366644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.366787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.366936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.367090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.367241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.367401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.367553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.367746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.367746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.368030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.368186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.368347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.368491 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.368632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.368880 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.369041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.369198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.369341 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.369491 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.369639 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.369788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.369788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.370092 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.370316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.370482 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.370626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.370786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.370937 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:23:29.371096 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.371324 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.371470 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.371641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.371799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.371953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.372115 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.372571 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.372724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.372912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373069 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373511 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.373954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.374097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.374252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.374395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.374538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.374697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.374849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.375000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.375153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.375303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.375445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.375956 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.376112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.376263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.376415 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.376559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.376708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.376873 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377185 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377339 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377631 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377829 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.377978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.378133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.378283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.378434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.378577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.378727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.378870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379032 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379466 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379757 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.379913 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.380058 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.380200 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.380200 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.380571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.380722 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.380958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.381102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.381244 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.381395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.381546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.381712 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.381865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.382115 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.382265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.382816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.382816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.383114 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.383259 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.383411 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.383560 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.383713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.383856 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384010 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384296 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384445 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384595 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.384916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.385058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.385218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.385371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.385371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.385692 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.386017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.386333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.386490 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.386641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.386783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.386938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.387082 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.387224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.387406 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.387557 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.387711 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.387912 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388350 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388656 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388826 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.388982 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.389125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.389268 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.389409 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.389564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.389719 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.389861 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.390009 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.390160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.390311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.390488 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.390716 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.390884 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.391166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.391166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.391471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.391629 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.391792 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.391933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.392082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.392224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.392376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.392546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.392988 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.393131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.393284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.393435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.393587 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.393738 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.393888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394198 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394507 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394651 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394802 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.394950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.395228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.395379 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.395528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.395670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.395819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.396143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.396496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.396649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.396825 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.396982 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.397125 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.397275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.397432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.397583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.397727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.397870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.398071 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.398225 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.398380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.398531 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.398673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.398822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399174 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399624 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399778 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.399922 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.400074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.400228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.400380 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.400523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.400689 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.400984 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.401148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.401293 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.401435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.401577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.401730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.401871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.402100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.402253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.402406 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.402556 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.402716 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.403691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.403846 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404005 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404298 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.404909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405065 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405823 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.405968 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.406288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.406462 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.406804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.406960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.407110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.407254 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.407403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.407403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.407700 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.407850 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.408050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.408206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.408359 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.408584 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.408819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.408980 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.409130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.409273 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.409273 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.409579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.409730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.409873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410462 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.410886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.411269 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.411432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.411594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.411737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.412413 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.412566 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.412709 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.412902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.412902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.413276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.413420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.413814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.414084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.414263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.414416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.414588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.414746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.414746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415046 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415806 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.415806 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.416117 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.416427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.416593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.416814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.417054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.417226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.417377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.417627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.417627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.417917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.418118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.418287 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.418436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.418646 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.419303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.419465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.419635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.419787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.419934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.420090 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.420247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.420396 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.420553 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.420702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.420875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421417 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421893 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.421893 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.422195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.422348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.422510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.422668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.422824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.422989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.423155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.423390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.423546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.423915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.424074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.424266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.424424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.424583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.424741 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.424944 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.425102 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.425252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.425409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.425573 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.425724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.425872 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.426038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.426196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.426526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.426695 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.426847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.426995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.427255 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.427419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.427627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.427902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428067 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428427 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.428932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429676 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429826 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.429973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.430279 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.430438 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.430608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.430767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.430917 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.431065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.431213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.431470 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.431806 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.432019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.432178 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.432332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.432490 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.432649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.432858 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.433015 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.433175 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.433333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.433590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.433590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.434141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.434303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.434462 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.434612 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.434783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.434934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.435083 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.435243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.435400 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.435566 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.435725 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.435875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.436023 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.436179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.436342 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.436510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.436846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.437012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.437173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.437430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.437603 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.437762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.438010 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.438166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.438357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.438357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.438734 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.438901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439511 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439511 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439825 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.439983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.440132 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.440282 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.440440 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.440591 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.440740 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.440929 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.441087 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.441244 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.441395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.441640 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.441809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.441969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.442132 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.442290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.442440 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.442597 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.442747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.442911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.443062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.443218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.443367 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.443524 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.443760 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.443937 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.444301 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.444458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.444607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.444803 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.445066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.445353 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.445524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.445676 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.445824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.445987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.446153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.446312 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.446475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.446633 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.446949 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.447108 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.447267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.447436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.447678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.447841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.448010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.448259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.448462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.448617 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.448817 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.448976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.449136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.449303 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.449461 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.449613 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.449785 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.449950 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450733 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.450902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.451197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.451356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.451513 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.451755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.451912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.452076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.452237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.452396 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.452547 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.452696 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.452889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.453061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.453220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.453379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.453537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.453687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.453929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.454120 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.454470 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.454632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.454783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.454932 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.455091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.455250 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.455412 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.455632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.455788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.455939 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.456101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.456253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.456402 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.456560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.456710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.457053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.457221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.457514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.457702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.457945 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.458100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.458268 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.458554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.458713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.458864 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459022 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459172 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.459962 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.460120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.460281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.460432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.460591 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.460804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.460973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.461124 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.461284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.461441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.461599 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.461775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462509 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462660 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.462959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.463116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.463280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.463437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.463595 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.463745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.463914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.464149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.464500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.464666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.464836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.464993 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.465153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.465312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.465988 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.466148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.466299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.466448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.466605 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.466764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.466915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.467231 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.467397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.467627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.467783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.467959 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.468203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.468359 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.468630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.468833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.469001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.469153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.469301 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.469460 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.469618 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470019 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470186 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470345 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470502 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470802 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.470966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.471130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.471282 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.471438 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.471595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.472021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.472243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.472409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.472559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.472719 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.472894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.473965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.474157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.474519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.474687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.474846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.474997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.475155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.475319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.475478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.475629 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.475778 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.475934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.476091 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.476860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.477023 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.477358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.477519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.477752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.477917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.478089 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.478347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.479193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.479373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.479373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.479672 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.479843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480162 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480461 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480618 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480801 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.480958 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.481181 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.481341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.481491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.481648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.481799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.481978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.482130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.482390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.482638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.482811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.482963 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.483121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.483856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.484023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.484023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.484324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.484722 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.485004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.485294 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.485459 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.485610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.485769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.485920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.486083 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.486234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.486383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.486531 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.486680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.486843 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.487002 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.487170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.487347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.487671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.487920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.488092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.488284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.488437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.488595 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.488903 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.489056 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.489763 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.489851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.489933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490381 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490454 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490532 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490532 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490692 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.490989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491381 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491543 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491615 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491758 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491758 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491892 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.491971 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492355 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492445 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492598 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492740 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.492963 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493122 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493529 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493721 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493837 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.493915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494061 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494370 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494520 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494757 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.494992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495223 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495295 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495611 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495773 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.495929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496009 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496286 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496358 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496584 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.496960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497056 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497141 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497317 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497495 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497582 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.497956 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498292 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498390 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498568 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498651 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498741 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498813 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.498976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499059 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499220 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499302 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499750 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.499930 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500286 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500375 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500826 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.500914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501265 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501616 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501698 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.501966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502583 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.502992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503376 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503781 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.503987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.504080 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.504294 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.504399 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.504597 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.504697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.504969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.505062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.505279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.505393 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.505643 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.505755 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.505916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506009 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506538 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.506941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.507158 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.507251 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.507469 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.507569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.507786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.507925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.508103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.508214 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.508407 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.508500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.508714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.508883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.509053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.509155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.509371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.509470 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.509689 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.509794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.510993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.511211 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.511309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.511523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.511622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.511837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.511930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.512151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.512266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.512505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.512652 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.512853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.513174 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.513281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.513495 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.513774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.513875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.514121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.514337 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.514441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.514739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.514944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.515051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.515355 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.515543 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.515721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.515978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.516117 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.516548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.516729 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.516941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.518177 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.518177 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520587 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.520806 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.522797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.522797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.522797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.522797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523274 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523474 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523750 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.523840 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.525993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.526923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.527008 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.527233 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.527339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.527475 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.527800 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.528414 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.528653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.529017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531522 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531592 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531684 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531782 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.531968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532563 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.532852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533005 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533088 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533618 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.533947 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.534188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.534281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.534512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.534604 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.534823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.534915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.535154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.535246 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.535464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.535553 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.535775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.535874 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.536096 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.536336 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.536436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.536659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.536783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537150 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.537967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.538059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.538280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.538372 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.538588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.538735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.538914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539008 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.539940 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.540153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.540246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.540467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.540559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.540791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.540889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.541103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.541201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.541473 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.541592 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.541718 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.541811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.542027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.542269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.542442 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.542631 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.542752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.542959 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.543060 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.543298 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.543397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.544267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.544379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.544575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.544667 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.544927 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.545974 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.546176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.546268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.546494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.546592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.546810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.546953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.547123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.547274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.547442 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.547536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.547759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.547862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.548071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.548296 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.548396 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.548636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.548797 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549033 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549450 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549772 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.549976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.550067 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.550285 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.550375 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.550595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.550699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.550907 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.551006 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.551216 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.551326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.551611 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.551788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.551954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552575 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.552876 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553523 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.553990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.554152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.554299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.554482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.554607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.554792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.554916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.555103 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.555322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.555421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.555514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.555724 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.555851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.556054 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.556155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.556371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.556471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.556685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.556813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.557090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.557200 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.557405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.557550 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.557720 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.557944 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.558048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.558289 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.558382 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.558622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.558733 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.558956 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.559087 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.559297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.559410 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.559606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.559708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.559920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.560029 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.560233 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.560337 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.560562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.560671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.560903 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561538 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.561959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.562165 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.562265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.562478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.562580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.562794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.562894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.563107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.563206 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.563434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.563671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.563992 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.564082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.564155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.564376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.564485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.564681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.564800 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.565016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.565331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.565648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.565800 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.565952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.566093 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.566232 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.566392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.566542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.566700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.566851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567182 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567317 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567719 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.567952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.568052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.568272 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.568365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.568577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.568677 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.568909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569215 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569322 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569611 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569822 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.569921 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.570126 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.570227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.570438 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.570539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.570745 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.570898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.571050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.571219 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.571354 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.571546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.571691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.571894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572616 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.572998 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.573207 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.573299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.573534 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.573622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.573851 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.574007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.574190 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.574283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.574513 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.574605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.575379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.575493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.575699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.575791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576011 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576320 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.576971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.577085 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.577290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.577450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.577591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.577734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.577888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578186 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578778 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.578950 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.579121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.579283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.579435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.579578 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.579720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.579870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580018 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580165 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.580938 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581228 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581375 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.581971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.582158 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.582303 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.582456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.582614 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.582770 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.582921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583375 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583825 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.583968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.584109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.584257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.584406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.584556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.584695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.584882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.585850 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.586075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.586170 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.586403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.586504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.586725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.586831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587036 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587386 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587491 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.587911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:23:29.588008 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.588280 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.588594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.588930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.589250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.589581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.589898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.590209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.591106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.591433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.591758 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.592077 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.592392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.592727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.593061 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.593376 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.593687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.593998 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.594311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.594630 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.594943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.595256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.595574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.595891 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.596221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.596550 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.597139 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.597491 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.597798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.598152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.598468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.598814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.599183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.599481 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.599795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.600106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:23:29.600353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:23:29.651273 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO dbcounter [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Registered counter for database nova_api Sep 15 12:23:29.663017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO dbcounter [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Registered counter for database nova_api Sep 15 12:23:29.671776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_db.sqlalchemy.engines [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.678423 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writer thread running {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.683501 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_db.sqlalchemy.engines [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.690605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writer thread running {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.734364 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.context [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6933a6ed-ec74-4c8d-8925-fcb2307d9c1c(cell1) {{(pid=120436) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:23:29.738369 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:23:29.738858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:23:29.740398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:23:29.741147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:23:29.741588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:23:29.743589 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:23:29.745608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO dbcounter [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Registered counter for database nova_cell0 Sep 15 12:23:29.745875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.context [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6933a6ed-ec74-4c8d-8925-fcb2307d9c1c(cell1) {{(pid=120437) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 12:23:29.750211 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO dbcounter [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Registered counter for database nova_cell1 Sep 15 12:23:29.750518 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:23:29.750996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:23:29.752639 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:23:29.753404 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:23:29.753851 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:23:29.755891 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:23:29.757671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_db.sqlalchemy.engines [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.757979 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO dbcounter [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Registered counter for database nova_cell0 Sep 15 12:23:29.759072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_db.sqlalchemy.engines [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.762164 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO dbcounter [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Registered counter for database nova_cell1 Sep 15 12:23:29.765443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writer thread running {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.767474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writer thread running {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.769386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_db.sqlalchemy.engines [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.771664 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_db.sqlalchemy.engines [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.777229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writer thread running {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.779389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writer thread running {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.916324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO dbcounter [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Registered counter for database nova_cell0 Sep 15 12:23:29.925024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_db.sqlalchemy.engines [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.929671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writer thread running {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:29.930662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO dbcounter [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Registered counter for database nova_cell0 Sep 15 12:23:29.937329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_db.sqlalchemy.engines [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:23:29.941838 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writer thread running {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:23:30.252718 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: WARNING keystonemiddleware.auth_token [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:23:30.257815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: WARNING keystonemiddleware.auth_token [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:23:30.259983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: WARNING keystonemiddleware.auth_token [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:23:30.265109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: WARNING keystonemiddleware.auth_token [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:23:30.604958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: WARNING keystonemiddleware.auth_token [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:23:30.610522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: WARNING keystonemiddleware.auth_token [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 12:23:30.610983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: WARNING keystonemiddleware.auth_token [None req-f57dae08-5b42-4f1f-ada9-20ade93a907d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:23:30.616152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622d689e9c0 pid: 120436 (default app) Sep 15 12:23:30.617172 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: WARNING keystonemiddleware.auth_token [None req-05e3dd8a-0987-48a9-b4fa-93a0d4639717 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 12:23:30.622487 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622d689e9c0 pid: 120437 (default app) Sep 15 12:24:07.326173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:07.327645 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:07.329443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:07.331027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:09.232666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-db9b7ab1-ea97-4c2a-9e61-8ab2b43be71d tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Action: 'create', calling method: .version_select at 0x7ff0d156e430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-304458682"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:10.390015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:10.390843 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:10.391627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:10.403201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:10.691466 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-db9b7ab1-ea97-4c2a-9e61-8ab2b43be71d tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.377984 Sep 15 12:24:10.706206 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Sep 15 12:24:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3394 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 12:24:10.714672 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fe6657a7-a65e-476e-843f-a55d3030cd35 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1440310>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:10.930594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fe6657a7-a65e-476e-843f-a55d3030cd35 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 200 len: 344 microversion: 2.1 time: 0.190063 Sep 15 12:24:10.930594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:10 2022] GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:11.096846 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-515a766c-9df8-4614-97ce-2ca20ecc8e06 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d15c4040>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:11.917066 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-efd431a6-a019-4178-a011-21e90f50c216 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d14409d0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:11.922464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-515a766c-9df8-4614-97ce-2ca20ecc8e06 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/59bb14c2-ddbc-4d68-8ac1-624853ff97c0" status: 200 len: 351 microversion: 2.1 time: 1.538467 Sep 15 12:24:11.934317 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 1/3] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:10 2022] GET /compute/v2.1/os-volumes/59bb14c2-ddbc-4d68-8ac1-624853ff97c0 => generated 351 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:12.014758 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-efd431a6-a019-4178-a011-21e90f50c216 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 200 len: 345 microversion: 2.1 time: 0.102197 Sep 15 12:24:12.015341 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:11 2022] GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:24:12.030277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2c53c34e-6edc-445c-b835-1e42116ce976 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Action: 'create', calling method: .version_select at 0x7ff0d142a280>, body: {"snapshot": {"volume_id": "979d33de-a3ea-4fa9-939a-0c76fb8b3ea5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-341868145"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:12.505929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2c53c34e-6edc-445c-b835-1e42116ce976 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.481124 Sep 15 12:24:12.506993 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 2/5] 10.222.0.15 () {60 vars in 1162 bytes} [Thu Sep 15 12:24:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:12.519397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-aa4319c3-8b35-4732-a426-cb2c6b9a2141 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d13d60d0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:12.610077 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-aa4319c3-8b35-4732-a426-cb2c6b9a2141 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 200 len: 286 microversion: 2.1 time: 0.094920 Sep 15 12:24:12.610977 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 4/6] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:12 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:12.625804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0cacd01e-1ce5-4bb8-8895-35e8f626918f tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d142ac10>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:12.778360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0cacd01e-1ce5-4bb8-8895-35e8f626918f tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.158261 Sep 15 12:24:12.779744 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Sep 15 12:24:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:12.791917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-425af0ea-14f1-44f4-8477-629b3452997f tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1440ca0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:12.839031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-425af0ea-14f1-44f4-8477-629b3452997f tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 200 len: 286 microversion: 2.1 time: 0.051837 Sep 15 12:24:12.840165 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:12 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:13.853176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-24592871-b6e9-44d2-8c4f-2f27ea6500bb tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1448940>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:13.919708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-24592871-b6e9-44d2-8c4f-2f27ea6500bb tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 200 len: 286 microversion: 2.1 time: 0.070214 Sep 15 12:24:13.926992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 4/9] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:13 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:24:14.936542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-081161c2-60b6-430d-a04d-5ab897a4e2d5 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d14405e0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:15.064495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-081161c2-60b6-430d-a04d-5ab897a4e2d5 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 200 len: 286 microversion: 2.1 time: 0.133459 Sep 15 12:24:15.065665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:14 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:16.078351 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5ba5e6e7-e694-4463-815e-95cd12a64415 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1448700>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:16.143803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5ba5e6e7-e694-4463-815e-95cd12a64415 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 200 len: 287 microversion: 2.1 time: 0.070091 Sep 15 12:24:16.144494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:16 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:16.158814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8eb43770-4a82-4000-9d9b-3472321de38c tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d13d61f0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:16.399552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8eb43770-4a82-4000-9d9b-3472321de38c tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 202 len: 0 microversion: 2.1 time: 0.245086 Sep 15 12:24:16.400512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Sep 15 12:24:16 2022] DELETE /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:24:16.412288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-eb26b767-33f3-45fb-af2f-d60b49e6fb33 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1d98820>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:16.471625 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-eb26b767-33f3-45fb-af2f-d60b49e6fb33 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 200 len: 286 microversion: 2.1 time: 0.065158 Sep 15 12:24:16.477319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:16 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:17.062332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-827e74ed-cf3b-435e-a1d0-c7a3452f2e1a tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d14403a0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:17.188026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-827e74ed-cf3b-435e-a1d0-c7a3452f2e1a tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/3109bd72-a22a-4034-92ab-d73dfddaab1c" status: 200 len: 350 microversion: 2.1 time: 0.130116 Sep 15 12:24:17.193486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:17 2022] GET /compute/v2.1/os-volumes/3109bd72-a22a-4034-92ab-d73dfddaab1c => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:17.486369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-eefe2cd5-02d8-4450-9101-849749549f29 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d142a1f0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:17.569976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-eefe2cd5-02d8-4450-9101-849749549f29 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] HTTP exception thrown: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-eefe2cd5-02d8-4450-9101-849749549f29 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Request method failure captured: Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 HTTP/1.1 Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxlnEOXkukjLQGJ64bCTeMBWLqrmmWlyh2aQ_VhtNlvoL_LvYaFEFA_uRgdSuB-g1lHOP5A-z4E63wNRsexFCY5TdgdrQiYsSTd_u4B_dE1E1oAJWiEJLg9lBawv94K8T74imp92LbtNMSvKLwGt78dkDPRRWKXDkaueI3QbdqOUs_4 Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:17.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 7b8262b6c3a04914a89ed3548af3bf7b Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'c7b3eab9-2f56-4222-9f93-221f2cad1116'} Sep 15 12:24:17.580621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. (HTTP 404) (Request-ID: req-377ca2ef-f52d-42bf-8d00-9ea929abd6fd) Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.581343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:17.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 15 12:24:17.588028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. Sep 15 12:24:17.590457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:17.593892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-eefe2cd5-02d8-4450-9101-849749549f29 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Returning 404 to user: Snapshot c7b3eab9-2f56-4222-9f93-221f2cad1116 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:17.597502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-eefe2cd5-02d8-4450-9101-849749549f29 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116" status: 404 len: 111 microversion: 2.1 time: 0.115345 Sep 15 12:24:17.600712 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 12:24:17 2022] GET /compute/v2.1/os-snapshots/c7b3eab9-2f56-4222-9f93-221f2cad1116 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:17.617455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-10f7bd57-812d-4ea8-9e9b-edf9bb331f0e tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1440af0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:17.940786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-10f7bd57-812d-4ea8-9e9b-edf9bb331f0e tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 202 len: 0 microversion: 2.1 time: 0.334846 Sep 15 12:24:17.942193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:24:17 2022] DELETE /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:24:17.951346 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-731e7ac6-732d-4cfc-b94a-78035f900d01 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d142aa60>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:18.054277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-731e7ac6-732d-4cfc-b94a-78035f900d01 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 200 len: 344 microversion: 2.1 time: 0.107859 Sep 15 12:24:18.055657 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:17 2022] GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:19.074860 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6b4ad318-5c9c-49dd-b64a-7a786983c79b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d13d6700>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:19.151037 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-6b4ad318-5c9c-49dd-b64a-7a786983c79b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] HTTP exception thrown: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6b4ad318-5c9c-49dd-b64a-7a786983c79b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Request method failure captured: Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 HTTP/1.1 Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxlnEOXkukjLQGJ64bCTeMBWLqrmmWlyh2aQ_VhtNlvoL_LvYaFEFA_uRgdSuB-g1lHOP5A-z4E63wNRsexFCY5TdgdrQiYsSTd_u4B_dE1E1oAJWiEJLg9lBawv94K8T74imp92LbtNMSvKLwGt78dkDPRRWKXDkaueI3QbdqOUs_4 Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:24:19.157109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 7b8262b6c3a04914a89ed3548af3bf7b Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '979d33de-a3ea-4fa9-939a-0c76fb8b3ea5'} Sep 15 12:24:19.158367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. (HTTP 404) (Request-ID: req-a42cab3d-4e94-4abe-8cb4-0c93a95406ce) Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.159081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:19.160039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 12:24:19.161586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.164345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.169445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6b4ad318-5c9c-49dd-b64a-7a786983c79b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Returning 404 to user: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:19.170732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6b4ad318-5c9c-49dd-b64a-7a786983c79b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 404 len: 109 microversion: 2.1 time: 0.104789 Sep 15 12:24:19.171734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:19 2022] GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:19.182469 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-aa8db345-9530-4814-9613-6cf6d0143c3b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d13b8280>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:19.239581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-aa8db345-9530-4814-9613-6cf6d0143c3b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] HTTP exception thrown: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-aa8db345-9530-4814-9613-6cf6d0143c3b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Request method failure captured: Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 HTTP/1.1 Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxlnEOXkukjLQGJ64bCTeMBWLqrmmWlyh2aQ_VhtNlvoL_LvYaFEFA_uRgdSuB-g1lHOP5A-z4E63wNRsexFCY5TdgdrQiYsSTd_u4B_dE1E1oAJWiEJLg9lBawv94K8T74imp92LbtNMSvKLwGt78dkDPRRWKXDkaueI3QbdqOUs_4 Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:19.242041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 7b8262b6c3a04914a89ed3548af3bf7b Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '979d33de-a3ea-4fa9-939a-0c76fb8b3ea5'} Sep 15 12:24:19.243257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. (HTTP 404) (Request-ID: req-8245e973-f2f0-4469-a266-fec15a9f327b) Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.243991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:24:19.246915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 12:24:19.247804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-aa8db345-9530-4814-9613-6cf6d0143c3b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Returning 404 to user: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:19.248683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-aa8db345-9530-4814-9613-6cf6d0143c3b tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 404 len: 109 microversion: 2.1 time: 0.067423 Sep 15 12:24:19.249727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:24:19 2022] DELETE /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:19.263524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-99a175a0-e906-4088-af80-8835857d0458 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Calling method '.version_select at 0x7ff0d1448f70>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:19.351637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-99a175a0-e906-4088-af80-8835857d0458 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] HTTP exception thrown: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-99a175a0-e906-4088-af80-8835857d0458 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Request method failure captured: Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 HTTP/1.1 Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxlnEOXkukjLQGJ64bCTeMBWLqrmmWlyh2aQ_VhtNlvoL_LvYaFEFA_uRgdSuB-g1lHOP5A-z4E63wNRsexFCY5TdgdrQiYsSTd_u4B_dE1E1oAJWiEJLg9lBawv94K8T74imp92LbtNMSvKLwGt78dkDPRRWKXDkaueI3QbdqOUs_4 Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:19.355046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59ace7b38143442bb6a511c14cb13a9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 59ace7b38143442bb6a511c14cb13a9a Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565397457 Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 7b8262b6c3a04914a89ed3548af3bf7b Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565397457-project Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '979d33de-a3ea-4fa9-939a-0c76fb8b3ea5'} Sep 15 12:24:19.356145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. (HTTP 404) (Request-ID: req-f983f4a7-35b3-4443-8655-55e3d754ef3e) Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.357995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:19.358996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 12:24:19.359972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-99a175a0-e906-4088-af80-8835857d0458 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] Returning 404 to user: Volume 979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:19.361021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-99a175a0-e906-4088-af80-8835857d0458 tempest-VolumesSnapshotsTestJSON-565397457 tempest-VolumesSnapshotsTestJSON-565397457-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5" status: 404 len: 109 microversion: 2.1 time: 0.105739 Sep 15 12:24:19.361692 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 10/20] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:19 2022] GET /compute/v2.1/os-volumes/979d33de-a3ea-4fa9-939a-0c76fb8b3ea5 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:19.438485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1825611a-2116-433b-81a8-49ab233a0bbc tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d1448dc0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:19.574070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-960434064", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "networks": [{"uuid": "e4774362-7184-471f-bbfc-4406ca003d99"}]}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:19.601911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1825611a-2116-433b-81a8-49ab233a0bbc tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/71746cab-cbcb-4ae6-bfda-c16245217a7c" status: 200 len: 350 microversion: 2.1 time: 0.167603 Sep 15 12:24:19.602775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 11/21] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:19 2022] GET /compute/v2.1/os-volumes/71746cab-cbcb-4ae6-bfda-c16245217a7c => generated 350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:19.617388 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6c410290-55b4-449f-ad1c-b6a543894637 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d142a280>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:19.901416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] validate_networks() for [('e4774362-7184-471f-bbfc-4406ca003d99', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:24:19.913630 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6c410290-55b4-449f-ad1c-b6a543894637 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.299941 Sep 15 12:24:19.914661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Sep 15 12:24:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:19.928854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9aa7df66-f4f8-4305-a2ac-b4c9bcc22ec6 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d13b8f70>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:20.197348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9aa7df66-f4f8-4305-a2ac-b4c9bcc22ec6 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.272363 Sep 15 12:24:20.211611 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1149 bytes} [Thu Sep 15 12:24:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:20.220739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a42104cf-c99f-45f8-bdca-8ac6328ea3ca tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d13b6310>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:20.449956 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a42104cf-c99f-45f8-bdca-8ac6328ea3ca tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.236127 Sep 15 12:24:20.460655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 14/24] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Sep 15 12:24:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:20.468939 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b1ab3f21-eb31-490e-a48a-a15c0a97cc20 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d13b68b0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:20.746996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b1ab3f21-eb31-490e-a48a-a15c0a97cc20 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.284634 Sep 15 12:24:20.747919 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 15/25] 10.222.0.15 () {58 vars in 1167 bytes} [Thu Sep 15 12:24:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:20.786856 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b420ad34-264c-4f8b-911c-106d5f9d9263 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d13c44c0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:21.038086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b420ad34-264c-4f8b-911c-106d5f9d9263 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.276039 Sep 15 12:24:21.039226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 16/26] 10.222.0.15 () {58 vars in 1170 bytes} [Thu Sep 15 12:24:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:21.054121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-323ea87c-1fc8-455b-ac2d-b57cf9b05413 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d13b8160>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:21.382790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-323ea87c-1fc8-455b-ac2d-b57cf9b05413 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.332289 Sep 15 12:24:21.384444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 17/27] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Sep 15 12:24:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:21.404968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5556e67a-6ffd-4b59-b5ae-57b25ace2044 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d142a310>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:21.662058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5556e67a-6ffd-4b59-b5ae-57b25ace2044 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.264725 Sep 15 12:24:21.662646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 18/28] 10.222.0.15 () {58 vars in 1188 bytes} [Thu Sep 15 12:24:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:21.678562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b5622cfe-51b0-469c-a87b-943b2dacf025 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] Calling method '.version_select at 0x7ff0d13b8f70>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:21.925780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b5622cfe-51b0-469c-a87b-943b2dacf025 tempest-VolumesTestJSON-289515177 tempest-VolumesTestJSON-289515177-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.252802 Sep 15 12:24:21.927383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 19/29] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Sep 15 12:24:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:22.779264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:24:22.779935 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:24:22.780436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:24:22.781187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:24:22.781973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:24:22.832590 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:22.836590 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:22.837238 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:22.840153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:22.842385 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:22.843642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:22.921678 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Getting quotas for project 705a7022acf04881bed0e40d7a491dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:22.941546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Getting quotas for user b5c77cfb2ad8404f9d0dff4f9bdb98ba and project 705a7022acf04881bed0e40d7a491dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:22.971491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:24:22.983671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:24:23.293266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-442cfcfe-dfb8-418d-932e-ad9882d6f196 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.057595 Sep 15 12:24:23.296191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 11/30] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:24:23.311541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-52cc8cf4-3af3-4e34-9604-64c0c2b06e6d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:23.312156 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-52cc8cf4-3af3-4e34-9604-64c0c2b06e6d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:23.647957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-52cc8cf4-3af3-4e34-9604-64c0c2b06e6d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:23.700782 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-52cc8cf4-3af3-4e34-9604-64c0c2b06e6d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1214 microversion: 2.1 time: 0.383182 Sep 15 12:24:23.700782 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 12/31] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:23 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:24.082809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c167e034-6e2c-4289-8e1d-b4bb8105d50f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: .version_select at 0x7ff0d13b8d30>, body: {"keypair": {"name": "tempest-keypair-1999682757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNNcFGwfhGPQpfe7p9rIs92wJKXaDipzeW4IlN2ie44fBT0NbIOkt2HA8PEy3rj3jtuizhTgKfC+FESPcCFg6PcfdzW+lZdeA8dQxqEqB85+p2Ks9fo/4ONYLoQffPpXw=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:24.194328 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-c167e034-6e2c-4289-8e1d-b4bb8105d50f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:24.211362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-c167e034-6e2c-4289-8e1d-b4bb8105d50f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for user 89cc4de76c6a4305af9a9506840e13f6 and project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:24.313859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c167e034-6e2c-4289-8e1d-b4bb8105d50f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.079721 Sep 15 12:24:24.315341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 20/32] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:24:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:24.431494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b8b66604-9383-4210-9281-edd524b7ef68 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'create', calling method: .version_select at 0x7ff0d13d6dc0>, body: {"keypair": {"name": "tempest-keypair-1832089907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIp+/pvZKlZcjp1Cehcwjt/eElzAaLOclQTFfhf1CCn5DZlrORCg4rqu3v9xt8DaksH+uBofdwC8HQcS1a1z7qM/E/gupYlfWdr41XogKXGnrok3XwHg04Grh4tJqGiew=="}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:24.488267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-b8b66604-9383-4210-9281-edd524b7ef68 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:24.493686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-b8b66604-9383-4210-9281-edd524b7ef68 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for user 1c42d5435a514bc0880b69fbbc163d32 and project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:24.553324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b8b66604-9383-4210-9281-edd524b7ef68 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.862224 Sep 15 12:24:24.554505 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 13/33] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Sep 15 12:24:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 864 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 12:24:24.734010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-777d9a59-b7b0-4e96-ba1b-2efe080e4647 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:24.735296 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-777d9a59-b7b0-4e96-ba1b-2efe080e4647 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:25.193653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-777d9a59-b7b0-4e96-ba1b-2efe080e4647 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:25.229933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-777d9a59-b7b0-4e96-ba1b-2efe080e4647 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1214 microversion: 2.1 time: 0.496394 Sep 15 12:24:25.233786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 21/34] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:24 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1214 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:25.847151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f7460a9c-865b-4084-aba6-1ce23e551244 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Action: 'create', calling method: .version_select at 0x7ff0d13d64c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1410368582", "metadata": {"Type": "work"}}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f7460a9c-865b-4084-aba6-1ce23e551244 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Request method failure captured: Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 122 Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl5qGqZrPXKqikYYU04EwS4Vf2pnd3d1Dmp_-oBMduqPSrDr4B13k_f2U2peSvm3e80YlM_RVTaetC8dbqXnmjWu7fjWvA3AU7UUENZobtaLTaPALH1yWvhvobEw4dQZzL1J4k9yd6HfDC3cb3r1Yfi03klYcALRBPIf6uMcKXn_mo Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:24:25.887398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: bf614c2c47ba44f7acab0a3c54217959 Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1410368582", "metadata": {"Type": "work"}}} Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: Sep 15 12:24:25.888856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1410368582', 'metadata': {'Type': 'work'}}}} Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise error Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi '#$%' Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:25.890267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 12:24:25.892038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 12:24:25.893326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 12:24:25.893326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.895321 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f7460a9c-865b-4084-aba6-1ce23e551244 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:25.898657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f7460a9c-865b-4084-aba6-1ce23e551244 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.599385 Sep 15 12:24:25.903635 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 14/35] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 12:24:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 605 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:24:25.914958 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b459bd-d11b-42b0-b86a-6f1491dd4825 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Action: 'create', calling method: .version_select at 0x7ff0d12f51f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-236994376", "metadata": {"Type": "work"}}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b459bd-d11b-42b0-b86a-6f1491dd4825 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Request method failure captured: Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 119 Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl5qGqZrPXKqikYYU04EwS4Vf2pnd3d1Dmp_-oBMduqPSrDr4B13k_f2U2peSvm3e80YlM_RVTaetC8dbqXnmjWu7fjWvA3AU7UUENZobtaLTaPALH1yWvhvobEw4dQZzL1J4k9yd6HfDC3cb3r1Yfi03klYcALRBPIf6uMcKXn_mo Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:25.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: bf614c2c47ba44f7acab0a3c54217959 Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-236994376", "metadata": {"Type": "work"}}} Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:25.923923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-236994376', 'metadata': {'Type': 'work'}}}} Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise error Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi '0' Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:25.924735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 12:24:25.926117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 12:24:25.927222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 12:24:25.927222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.933969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b459bd-d11b-42b0-b86a-6f1491dd4825 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:25.935063 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d3b459bd-d11b-42b0-b86a-6f1491dd4825 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024359 Sep 15 12:24:25.937801 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 22/36] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 12:24:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:24:25.967826 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9515f809-ab1b-4912-bb29-c3e363f3418a tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Action: 'create', calling method: .version_select at 0x7ff0d0a16ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1801832983", "metadata": {"Type": "work"}}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9515f809-ab1b-4912-bb29-c3e363f3418a tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Request method failure captured: Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 119 Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl5qGqZrPXKqikYYU04EwS4Vf2pnd3d1Dmp_-oBMduqPSrDr4B13k_f2U2peSvm3e80YlM_RVTaetC8dbqXnmjWu7fjWvA3AU7UUENZobtaLTaPALH1yWvhvobEw4dQZzL1J4k9yd6HfDC3cb3r1Yfi03klYcALRBPIf6uMcKXn_mo Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:24:25.974879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: bf614c2c47ba44f7acab0a3c54217959 Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1801832983", "metadata": {"Type": "work"}}} Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: Sep 15 12:24:25.976528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1801832983', 'metadata': {'Type': 'work'}}}} Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise error Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi '' Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:25.977421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 12:24:25.978845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 12:24:25.983316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 12:24:25.983316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:24:25.989694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9515f809-ab1b-4912-bb29-c3e363f3418a tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:25.991215 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9515f809-ab1b-4912-bb29-c3e363f3418a tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.047857 Sep 15 12:24:25.993678 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 15/37] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 12:24:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 12:24:26.004168 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f6ee032b-5c56-4e6f-b95c-4f0f69ee2574 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Calling method '.version_select at 0x7ff0d130ca60>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:26.085667 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-f6ee032b-5c56-4e6f-b95c-4f0f69ee2574 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] HTTP exception thrown: Volume tempest-invalid-1529886470 could not be found. Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f6ee032b-5c56-4e6f-b95c-4f0f69ee2574 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Request method failure captured: Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1529886470 HTTP/1.1 Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl5qGqZrPXKqikYYU04EwS4Vf2pnd3d1Dmp_-oBMduqPSrDr4B13k_f2U2peSvm3e80YlM_RVTaetC8dbqXnmjWu7fjWvA3AU7UUENZobtaLTaPALH1yWvhvobEw4dQZzL1J4k9yd6HfDC3cb3r1Yfi03klYcALRBPIf6uMcKXn_mo Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:26.088026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: bf614c2c47ba44f7acab0a3c54217959 Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Volume tempest-invalid-1529886470 could not be found. Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'tempest-invalid-1529886470'} Sep 15 12:24:26.089312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1529886470 could not be found. (HTTP 404) (Request-ID: req-e3ae074a-f662-411d-b46c-7648a23be245) Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.090053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:24:26.091049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1529886470 could not be found. Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:26.091952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1529886470 could not be found. Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1529886470 could not be found. Sep 15 12:24:26.092935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.094422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f6ee032b-5c56-4e6f-b95c-4f0f69ee2574 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Returning 404 to user: Volume tempest-invalid-1529886470 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:26.095488 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f6ee032b-5c56-4e6f-b95c-4f0f69ee2574 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1529886470" status: 404 len: 99 microversion: 2.1 time: 0.095066 Sep 15 12:24:26.108563 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8a9103fb-dc05-4d61-bd0e-20d77e1b34ba tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004473 Sep 15 12:24:26.115439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 16/38] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Sep 15 12:24:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 12:24:26.120869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 23/39] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 12:24:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1529886470 => generated 99 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 12:24:26.135567 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-864d4193-212e-4e65-a7dd-6544f7a63602 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015686 Sep 15 12:24:26.138902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 17/40] 10.222.0.15 () {58 vars in 1137 bytes} [Thu Sep 15 12:24:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 12:24:26.168107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-62eaaa92-c6c2-4d46-aebb-3c6cd04ec0bc tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Calling method '.version_select at 0x7ff0d130c280>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:26.257467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:26.258542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:26.284379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:26.286529 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:26.294084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-62eaaa92-c6c2-4d46-aebb-3c6cd04ec0bc tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] HTTP exception thrown: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-62eaaa92-c6c2-4d46-aebb-3c6cd04ec0bc tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Request method failure captured: Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/os-volumes/68da5a1f-399f-4d70-936c-813ea60f7c85 HTTP/1.1 Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl5qGqZrPXKqikYYU04EwS4Vf2pnd3d1Dmp_-oBMduqPSrDr4B13k_f2U2peSvm3e80YlM_RVTaetC8dbqXnmjWu7fjWvA3AU7UUENZobtaLTaPALH1yWvhvobEw4dQZzL1J4k9yd6HfDC3cb3r1Yfi03klYcALRBPIf6uMcKXn_mo Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:26.296883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: bf614c2c47ba44f7acab0a3c54217959 Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '68da5a1f-399f-4d70-936c-813ea60f7c85'} Sep 15 12:24:26.298067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. (HTTP 404) (Request-ID: req-ee693ce5-77da-41ab-b83b-4a6b85ab8cfe) Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.298720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 12:24:26.299753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 12:24:26.300691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-62eaaa92-c6c2-4d46-aebb-3c6cd04ec0bc tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Returning 404 to user: Volume 68da5a1f-399f-4d70-936c-813ea60f7c85 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-62eaaa92-c6c2-4d46-aebb-3c6cd04ec0bc tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/68da5a1f-399f-4d70-936c-813ea60f7c85" status: 404 len: 109 microversion: 2.1 time: 0.154189 Sep 15 12:24:26.301679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 24/41] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:24:26 2022] DELETE /compute/v2.1/os-volumes/68da5a1f-399f-4d70-936c-813ea60f7c85 => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:26.302439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:26.304610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:26.321132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:26.323285 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:26.325504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5e56c183-5b6d-463d-b589-20eaa436b150 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Calling method '.version_select at 0x7ff0d130ca60>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:26.401088 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-5e56c183-5b6d-463d-b589-20eaa436b150 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] HTTP exception thrown: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5e56c183-5b6d-463d-b589-20eaa436b150 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Request method failure captured: Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/os-volumes/294ffe5d-759d-4af3-be41-e63503b90bd7 HTTP/1.1 Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl5qGqZrPXKqikYYU04EwS4Vf2pnd3d1Dmp_-oBMduqPSrDr4B13k_f2U2peSvm3e80YlM_RVTaetC8dbqXnmjWu7fjWvA3AU7UUENZobtaLTaPALH1yWvhvobEw4dQZzL1J4k9yd6HfDC3cb3r1Yfi03klYcALRBPIf6uMcKXn_mo Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:24:26.403991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7399ee4d636f40dc83046efefbff94a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7399ee4d636f40dc83046efefbff94a3 Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesNegativeTest-285020465 Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: bf614c2c47ba44f7acab0a3c54217959 Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesNegativeTest-285020465-project Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '294ffe5d-759d-4af3-be41-e63503b90bd7'} Sep 15 12:24:26.405117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. (HTTP 404) (Request-ID: req-2fac271f-f36d-42b5-b645-87c786315903) Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.405777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:24:26.407690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 12:24:26.409281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. Sep 15 12:24:26.413537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:24:26.418142 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5e56c183-5b6d-463d-b589-20eaa436b150 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] Returning 404 to user: Volume 294ffe5d-759d-4af3-be41-e63503b90bd7 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:24:26.419548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5e56c183-5b6d-463d-b589-20eaa436b150 tempest-VolumesNegativeTest-285020465 tempest-VolumesNegativeTest-285020465-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/294ffe5d-759d-4af3-be41-e63503b90bd7" status: 404 len: 109 microversion: 2.1 time: 0.107849 Sep 15 12:24:26.420782 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 25/42] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:24:26 2022] GET /compute/v2.1/os-volumes/294ffe5d-759d-4af3-be41-e63503b90bd7 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:27.025302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:27.048020 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f58b8050-039d-42e2-8815-c3eb4dc73141 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1210 microversion: 2.1 time: 0.796074 Sep 15 12:24:27.062900 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 18/43] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:26 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1210 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:28.073195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:28.073979 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:28.089320 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:28.089945 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:28.090617 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:28.099517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fc610374-ea52-4140-8e1c-8880a968910d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: .version_select at 0x7ff0d142aa60>, body: {"keypair": {"name": "tempest-keypair-136465553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5J6km8KsoSjgPjHFE/Q4R5qkL2WiohlQYBINiBLywcYolxYEgAUjZ+3kfa8ZwpNCWaXylhlQ8y/QfnkEwavksukyqA7417XqxlE6T4f4Rj4FoejKpCigBCmKlEBtF5g=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:28.105305 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:28.105914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:28.107300 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:28.166922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-fc610374-ea52-4140-8e1c-8880a968910d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:28.190546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-fc610374-ea52-4140-8e1c-8880a968910d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:28.240361 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fc610374-ea52-4140-8e1c-8880a968910d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.787204 Sep 15 12:24:28.241762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 26/44] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:24:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:28.295726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:28.311565 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1c2f8ead-17ce-4d00-89b5-59a571d82193 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1210 microversion: 2.1 time: 0.238103 Sep 15 12:24:28.313647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 19/45] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:28 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1210 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:29.336058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:29.337776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:29.355217 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:29.356237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:29.360270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:29.361402 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:29.364272 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:29.366361 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:29.935904 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:30.007345 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-57e4ebe7-371d-49fc-921c-4f04d7bf56e3 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1266 microversion: 2.1 time: 0.672790 Sep 15 12:24:30.037425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 27/46] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:29 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1266 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:30.842807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1999717259", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac718f64-2120-48e0-8b5c-3a613680e04c"}], "security_groups": [{"name": "tempest-securitygroup--660247550"}], "key_name": "tempest-keypair-1999682757", "user_data": "}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:31.037003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:31.038556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:31.066681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:31.070056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:31.072626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:31.076386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:31.077058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:31.077640 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:31.229788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] validate_networks() for [('ac718f64-2120-48e0-8b5c-3a613680e04c', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:24:31.333380 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:31.347701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-73cf97ce-5ff2-4121-b246-54fc04d15df4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1272 microversion: 2.1 time: 0.315396 Sep 15 12:24:31.350315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 28/47] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:31 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:32.375930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:32.377422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:32.393654 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:32.401349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:32.402003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:32.406191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:32.410098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:32.410868 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:32.843402 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:24:32.844623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:24:32.845413 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:24:32.846323 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:24:32.846946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:24:32.882690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:32.888084 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:32.891504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:32.900542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:32.901722 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:32.904312 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:32.905118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:32.992880 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:33.003406 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:33.004377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for user 89cc4de76c6a4305af9a9506840e13f6 and project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:33.023914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-496a4b84-ae7e-4c3d-8a29-cfb0ff5deacb tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1272 microversion: 2.1 time: 0.652559 Sep 15 12:24:33.027480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 29/48] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:32 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1272 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:33.052726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:24:33.066861 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:24:33.070046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1254459258", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b56cc68-11e6-40a5-bab2-e9f397e521ee"}], "security_groups": [{"name": "tempest-securitygroup--1298436264"}], "key_name": "tempest-keypair-1832089907", "user_data": "}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:33.213436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e0f7c0d6-1061-4a61-9f65-3470136d3073 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.375874 Sep 15 12:24:33.217084 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 20/49] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:24:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:24:33.235823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c08ff1bf-b2d7-40d7-a787-3e42cf4103e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:33.238667 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c08ff1bf-b2d7-40d7-a787-3e42cf4103e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:33.718544 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c08ff1bf-b2d7-40d7-a787-3e42cf4103e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:33.727970 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c08ff1bf-b2d7-40d7-a787-3e42cf4103e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1238 microversion: 2.1 time: 0.502624 Sep 15 12:24:33.728498 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 21/50] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:33 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1238 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:33.886765 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] validate_networks() for [('0b56cc68-11e6-40a5-bab2-e9f397e521ee', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:24:34.052792 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:34.060187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:34.076450 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:34.077316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:34.077968 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:34.078888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:34.079546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:34.080196 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:34.340571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:34.351946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-843663c3-6445-46dc-9ec0-4c9e17fe2d2a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1272 microversion: 2.1 time: 0.302857 Sep 15 12:24:34.355609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 22/51] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:34 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:34.626486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-449774082", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1f39d5a-ab5e-4464-9fc6-537bb91606a6"}], "security_groups": [{"name": "tempest-securitygroup--18186547"}], "key_name": "tempest-keypair-136465553", "user_data": "}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:35.319476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] validate_networks() for [('c1f39d5a-ab5e-4464-9fc6-537bb91606a6', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:24:36.498546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:24:36.504315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:24:36.505163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:24:36.505785 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:24:36.506398 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:24:36.553153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:36.555354 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:36.558441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:36.560007 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:36.564152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:36.566834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:36.717313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:36.734059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for user 1c42d5435a514bc0880b69fbbc163d32 and project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:36.762978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:24:36.768003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:24:36.952264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:24:36.952820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:24:36.953267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:24:36.953687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:24:36.954107 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:24:36.992434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:36.992977 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:36.999432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:36.999836 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-19ee2f87-c3c2-476d-b32f-2f9ac5b27338 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.970944 Sep 15 12:24:37.006060 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:37.006434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 30/52] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Sep 15 12:24:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3978 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 12:24:37.016195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:37.018542 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:37.019656 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:37.020477 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:37.070117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:37.070431 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:37.070886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:37.072179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:37.080425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:37.090648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:37.178343 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:24:37.212623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:24:37.278293 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:24:37.301815 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:24:37.422127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-92eac1ce-2ae8-4ec5-9bcf-ce9dc88d2c23 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.803324 Sep 15 12:24:37.423334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 23/53] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:24:34 2022] POST /compute/v2.1/servers => generated 400 bytes in 2807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:24:37.429476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:37.430482 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:37.461245 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:37.462012 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:37.462720 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:37.463662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:37.464334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:37.465016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:37.529472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:37.580480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8ba79f76-fa50-40f9-af2a-dfa5dd5d5fcd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1290 microversion: 2.1 time: 0.568908 Sep 15 12:24:37.589921 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 31/54] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:37 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1290 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:37.605831 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fcf3d02b-04d5-4d6a-b208-5cefdb16683a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:37.607938 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fcf3d02b-04d5-4d6a-b208-5cefdb16683a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:37.852142 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fcf3d02b-04d5-4d6a-b208-5cefdb16683a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:37.887206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fcf3d02b-04d5-4d6a-b208-5cefdb16683a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:37.900465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fcf3d02b-04d5-4d6a-b208-5cefdb16683a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:37.908666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fcf3d02b-04d5-4d6a-b208-5cefdb16683a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1282 microversion: 2.20 time: 0.310735 Sep 15 12:24:37.933566 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 32/55] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:37 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1282 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:37.938504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b9bf2b8c-83bf-4ec1-b743-808a5a8691f0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:37.939132 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b9bf2b8c-83bf-4ec1-b743-808a5a8691f0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:38.265106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b9bf2b8c-83bf-4ec1-b743-808a5a8691f0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:38.279933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b9bf2b8c-83bf-4ec1-b743-808a5a8691f0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1240 microversion: 2.1 time: 0.345146 Sep 15 12:24:38.288885 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 33/56] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:37 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1240 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:38.290854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:38.322240 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-28fd8349-f944-4c54-bef2-492cdc910ec0 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.888597 Sep 15 12:24:38.363738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 24/57] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:37 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:38.613494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:38.614221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:38.624466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:38.625676 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:38.626628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:38.627672 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:38.628460 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:38.629174 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:38.888613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:38.932065 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e0ab01f4-fe5c-47fd-851a-09dcc43f70c7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1296 microversion: 2.1 time: 0.318729 Sep 15 12:24:38.933436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 34/58] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:38 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1296 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:38.938714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:38.939654 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:38.951363 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:38.953155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:38.953955 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:38.960251 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:38.973039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:38.973876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:39.183537 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:39.209396 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:39.215495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:39.223985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-abbfe69d-72a1-4354-869f-995733320846 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1278 microversion: 2.20 time: 0.288373 Sep 15 12:24:39.224849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 25/59] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:38 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:39.313213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:39.314077 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:39.335288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:39.336405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:39.338129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:39.340034 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:39.343775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:39.346548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:39.358246 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:39.359261 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:39.406914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:39.411226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:39.416566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:39.423016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:39.426689 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:39.427214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:39.517245 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:39.546379 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7507a874-41f3-4109-8603-9836ad899e95 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1292 microversion: 2.1 time: 0.237896 Sep 15 12:24:39.547522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 35/60] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:39 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1292 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:39.826199 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:39.836389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-21184c1d-d4ab-4dd7-86b5-5659f8f00243 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.477163 Sep 15 12:24:39.837229 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 26/61] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:39 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:39.958866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:39.959958 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:39.977166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:39.978318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:39.978777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:39.979525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:39.980578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:39.980578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:40.150811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:40.164455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-41b4cbd4-a626-4709-ac1e-2fa36eeeb41a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1296 microversion: 2.1 time: 0.211956 Sep 15 12:24:40.168310 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 36/62] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:39 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1296 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:40.254565 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:40.255201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:40.264318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:40.264847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:40.265295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:40.266006 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:40.266472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:40.266897 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:40.376235 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:40.389659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:40.392943 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:40.395987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-723d3d43-684b-4222-be14-91474d928ffe tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1278 microversion: 2.20 time: 0.146075 Sep 15 12:24:40.397627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 27/63] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:40 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:40.574339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:40.574931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:40.593283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:40.593845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:40.594210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:40.594866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:40.595375 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:40.596012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:40.864474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:40.865998 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:40.889283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:40.890706 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:40.893672 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:40.895655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:40.897606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:40.900972 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:41.147539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:41.168628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-142d7fea-f981-4f55-a7a5-8cccfa5c209e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1292 microversion: 2.1 time: 0.599612 Sep 15 12:24:41.170172 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 37/64] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:40 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1292 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:41.191676 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:41.208800 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:41.255496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:41.255998 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:41.256432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:41.257192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:41.268499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:41.269029 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:41.566569 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:41.589471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-31976662-57d6-48ea-ad34-9fa9851be50c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1296 microversion: 2.1 time: 0.402553 Sep 15 12:24:41.590637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 38/65] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:41 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1296 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:41.604530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:41.607705 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:41.685728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:41.686212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:41.700062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:41.702511 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:41.707192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:41.707683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:41.718244 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:41.738721 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0adb9767-6350-4f19-bf3c-43b2aafa1853 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.874613 Sep 15 12:24:41.739372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 28/66] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:40 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:41.975824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:41.999729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:42.005710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:42.008206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b10516c1-6314-4dad-bcb6-887b9685a539 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1278 microversion: 2.20 time: 0.416442 Sep 15 12:24:42.013246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 39/67] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:41 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1278 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:42.196699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:42.197313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:42.207479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.207979 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.208421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.209165 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.215898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.218093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.351746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:42.364153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-31dddf9a-b02a-4195-9ca3-ed78b0634dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1300 microversion: 2.1 time: 0.173047 Sep 15 12:24:42.365525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 29/68] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:42 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:42.536278 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2bf7f9-471f-4d81-8def-0d99339b2002", "tag": "c93f975d-2440-49cf-8c83-705154f8f455"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:42.549224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.549789 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.550319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.569847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Creating event network-changed:c93f975d-2440-49cf-8c83-705154f8f455 for instance cf2bf7f9-471f-4d81-8def-0d99339b2002 on hv-cinder-85083 Sep 15 12:24:42.570458 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 12:24:42.571075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-acb93d2b-38fa-47cc-bd28-99e61d8d24f1 req-bb875560-ada0-42f7-b1cb-341781641fb1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 12:24:42.572421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.573012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.573509 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.574545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.575182 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.575766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.585359 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.compute.rpcapi [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 12:24:42.586223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] Releasing lock "compute-rpcapi-router" {{(pid=120437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 12:24:42.615933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:42.621123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-922a36be-d102-4471-ad3e-29440e25d29d None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373517 Sep 15 12:24:42.622048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 40/69] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:42.632728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:42.650863 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.652143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.652822 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.654300 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.655146 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.656562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.768990 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:42.769767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:42.783788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.785086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.785679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:42.790603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:42.791870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:42.792396 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:43.045113 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:43.057761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2fb6d148-ee1e-441f-b631-260f1c88298a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.447846 Sep 15 12:24:43.059251 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 30/70] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:42 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:43.082317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:43.085101 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:43.103740 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:43.105014 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:43.106455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:43.107406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:43.108081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:43.108735 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:43.151339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:43.166208 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a8efe5bc-c4b6-40ed-afa2-aa9ca65fbd71 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.403567 Sep 15 12:24:43.184786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 41/71] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:42 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:43.275855 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:43.291430 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:43.293809 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:43.307997 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b19276a1-b0c8-4f11-a278-f3ffe480944c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1278 microversion: 2.20 time: 0.233911 Sep 15 12:24:43.307997 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 31/72] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:43 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:43.389613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:43.390570 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:43.404247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:43.404748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:43.408511 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:43.409318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:43.409815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:43.410241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:43.510098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:43.521968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-45adf809-24b6-4dbe-b7a1-5af477e3aea7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1300 microversion: 2.1 time: 0.137810 Sep 15 12:24:43.538843 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 42/73] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:43 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:44.084104 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:44.085584 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:44.103440 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:44.104114 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:44.105797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:44.109715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:44.111580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:44.113629 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:44.191700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:44.192471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:44.200836 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:44.202488 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:44.203257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:44.204845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:44.206355 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:44.207333 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:45.237629 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:45.261830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-88c0b2be-eb19-4f98-b3ea-2d392c40b466 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 1.181597 Sep 15 12:24:45.276805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 32/74] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:44 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:45.296412 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:45.300325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:45.317119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:45.333773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:45.338737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:45.343574 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:45.344124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:45.345012 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:45.356438 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:45.367227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-035712e9-b820-4669-b7bb-1609dbadcc4a tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 1.180567 Sep 15 12:24:45.371505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 43/75] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:44 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:45.391254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:45.391900 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:45.405591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:45.406712 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:45.407400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:45.408128 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:45.410983 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:45.414283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:45.677926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:45.689525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:45.695662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:45.697941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0a9b5465-927a-4b64-8a57-34e126f13540 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1334 microversion: 2.20 time: 0.428131 Sep 15 12:24:45.704902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 33/76] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:45 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1334 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:45.772223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:45.793024 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3e0f0243-e3e3-451d-908c-cff3220a27e7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1298 microversion: 2.1 time: 0.419666 Sep 15 12:24:45.805220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 44/77] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:45 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1298 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:46.291069 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:46.291687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:46.300728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:46.305159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:46.307820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:46.310184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:46.330837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:46.331594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:46.341691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:46.400383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:46.401561 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:46.411105 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:46.419055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:46.419743 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:46.422175 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:46.422783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:46.424460 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.070260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:47.224416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:47.237665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ba8288ac-824b-4a5e-8c7a-cd328c43e374 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.950845 Sep 15 12:24:47.262835 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 34/78] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:46 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:47.268081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4481d43d-2a44-4a3c-b167-2b99e195a673", "tag": "7faf28c3-337f-487f-9e4b-3dc169341cac"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:47.286037 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=26 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:47.315138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.317019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.317665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.370391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Creating event network-changed:7faf28c3-337f-487f-9e4b-3dc169341cac for instance 4481d43d-2a44-4a3c-b167-2b99e195a673 on hv-cinder-85083 Sep 15 12:24:47.371332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120436) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 12:24:47.372029 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b7d9e1c2-c3e0-4ed0-888c-3b3d1a37d5fb req-135f0780-7c49-4365-9858-17bba2d9679a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120436) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 12:24:47.373623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.374297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.374957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.375882 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.376610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.377256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.391983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.compute.rpcapi [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 12:24:47.393582 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] Releasing lock "compute-rpcapi-router" {{(pid=120436) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 12:24:47.413284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f0902eea-eef7-46a5-a702-04aaf1285943 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150687 Sep 15 12:24:47.415554 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 35/79] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:47.421399 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:47.422623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:47.450450 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.450687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.451031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.452120 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.463136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.463694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.495810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:47.510397 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1bcdf0a6-b32b-4469-95b0-6da54a086444 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 1.115120 Sep 15 12:24:47.515071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 45/80] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:46 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:47.563952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:47.565832 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:47.599091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.599957 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.600624 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.601925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:47.603531 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:47.604540 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:47.657407 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:47.660555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=99 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:47.671447 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:47.673343 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:47.674928 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-560798e1-080b-4ed8-81e8-bb353c21d537 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1340 microversion: 2.20 time: 0.258067 Sep 15 12:24:47.675670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 36/81] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:47 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1340 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:47.675858 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=100 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:47.815206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:47.826468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a4538895-0d2c-4ece-a0ac-1eb81a291c13 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1298 microversion: 2.1 time: 0.305306 Sep 15 12:24:47.827651 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 46/82] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:47 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1298 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:48.270359 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:48.270961 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:48.282761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.283821 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.285184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.286485 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.288553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.293717 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.539880 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:48.540557 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:48.543750 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=20 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:48.550465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.551790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.552453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.553658 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.558783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.560169 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.847683 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:48.862538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f362161a-4af6-4351-abf5-84f4072c4fbf tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.595461 Sep 15 12:24:48.881719 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 37/83] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:48 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:48.894044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:48.895189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:48.913609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.914356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.915451 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.916447 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.917118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.917794 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.938534 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:48.946911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6d88a938-0ef7-418e-83de-394c2734c331 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.413437 Sep 15 12:24:48.947728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 47/84] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:48 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:48.958332 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:48.959235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:48.984445 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.985351 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.986022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:48.987094 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:48.987763 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:48.988411 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:49.413857 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:49.422965 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c89f4113-f8ef-445b-b8de-fc9758182189 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.473907 Sep 15 12:24:49.439407 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:49.441652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 48/85] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:48 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:49.461003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:49.463247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:49.465243 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1a9a8cab-c570-4279-9539-beeaa190fb28 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.579327 Sep 15 12:24:49.466051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 38/86] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:48 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:49.892818 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:49.894358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:49.905993 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:49.906899 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:49.907517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:49.908422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:49.909045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:49.909611 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:49.976175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:49.979106 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:49.990293 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:49.991197 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:49.992098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:49.993327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:49.993779 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:49.994454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:50.218575 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:50.224033 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:50.232142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a2bc0db2-7640-4edc-b43f-673e77c0af24 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.260563 Sep 15 12:24:50.232647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 39/87] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:49 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:50.232981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f361954b-6c46-4e62-8698-eb191a80714c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.341172 Sep 15 12:24:50.235190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 49/88] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:49 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:50.450179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:50.450921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:50.470168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:50.471279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:50.471935 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:50.473204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:50.474137 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:50.474824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:50.475029 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-65d918c5-4a01-4584-861a-9c6cbd142b91 req-17ddfec8-4453-4ccb-85d5-952382dabef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3545e504-2e9b-41e0-903c-f58ab4aa380a", "tag": "0116ca70-581b-40a9-8ad0-31dbb2d532e7"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:50.496594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-65d918c5-4a01-4584-861a-9c6cbd142b91 req-17ddfec8-4453-4ccb-85d5-952382dabef1 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:50.497013 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-65d918c5-4a01-4584-861a-9c6cbd142b91 req-17ddfec8-4453-4ccb-85d5-952382dabef1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:50.498987 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-65d918c5-4a01-4584-861a-9c6cbd142b91 req-17ddfec8-4453-4ccb-85d5-952382dabef1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:50.516528 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-65d918c5-4a01-4584-861a-9c6cbd142b91 req-17ddfec8-4453-4ccb-85d5-952382dabef1 service nova] Creating event network-changed:0116ca70-581b-40a9-8ad0-31dbb2d532e7 for instance 3545e504-2e9b-41e0-903c-f58ab4aa380a on hv-cinder-85083 Sep 15 12:24:50.522167 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-65d918c5-4a01-4584-861a-9c6cbd142b91 req-17ddfec8-4453-4ccb-85d5-952382dabef1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052150 Sep 15 12:24:50.522713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 50/89] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:24:50.530360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:50.531263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:50.539176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:50.540159 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:50.541017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:50.542073 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:50.543127 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:50.544265 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:50.805080 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:50.816562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-73a4e3a9-2fa7-4207-80ce-de2682249f6f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.372089 Sep 15 12:24:50.819253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 40/90] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:50 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:50.857343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:50.866635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:50.870007 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:50.878208 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-bacab8dc-469c-4069-9587-17954031f40e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.353405 Sep 15 12:24:50.879766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 51/91] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:50 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:51.255546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:51.256184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:51.259727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:51.260614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:51.266510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.267854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.271321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:51.273896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.275253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.276049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.276701 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.277824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.277973 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.278305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.282063 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.282544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.286765 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.788128 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:51.797902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fa0823e0-f2c2-4167-b3a6-e9a2cf301979 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.542156 Sep 15 12:24:51.807721 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:51.811636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 52/92] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:51 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:51.817642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b407b2ec-270e-4cff-af00-6ac01b3f0d55 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.566081 Sep 15 12:24:51.821615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 41/93] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:51 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:51.850448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:51.851950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:51.866130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.869160 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.869410 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.870146 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.870622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.872058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.914700 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:51.915483 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:51.925949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.927270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.927729 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:51.931119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:51.932300 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:51.932768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:52.230819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:52.239750 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-20178c14-20cc-45ab-aa95-4a4e1cd5d1a6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.398405 Sep 15 12:24:52.246769 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 53/94] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:51 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:52.251997 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:52.264641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:52.267360 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:52.269455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7d8e3f96-a525-4513-8a3d-895bba521e27 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.368253 Sep 15 12:24:52.271142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 42/95] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:51 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:52.547352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-89a75c2a-fcc9-46f1-80dd-045bcd1f0581 req-3be4ea98-2e19-4f75-883f-b324e2bc9337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:52.564119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-89a75c2a-fcc9-46f1-80dd-045bcd1f0581 req-3be4ea98-2e19-4f75-883f-b324e2bc9337 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:52.565117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-89a75c2a-fcc9-46f1-80dd-045bcd1f0581 req-3be4ea98-2e19-4f75-883f-b324e2bc9337 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:52.566483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-89a75c2a-fcc9-46f1-80dd-045bcd1f0581 req-3be4ea98-2e19-4f75-883f-b324e2bc9337 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:52.588465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=4 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:52.601682 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-89a75c2a-fcc9-46f1-80dd-045bcd1f0581 req-3be4ea98-2e19-4f75-883f-b324e2bc9337 service nova] Creating event network-changed:d1879643-5968-44a1-9897-dfed95801b5f for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 on hv-cinder-85083 Sep 15 12:24:52.608548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-89a75c2a-fcc9-46f1-80dd-045bcd1f0581 req-3be4ea98-2e19-4f75-883f-b324e2bc9337 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070033 Sep 15 12:24:52.610112 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 54/96] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:52.827600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:52.827600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:52.835880 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:52.837135 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:52.843307 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:52.844227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:52.848274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:52.850790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:52.854098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:52.854572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:52.857200 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:52.857483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:52.870530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:52.873444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:52.890414 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:52.892327 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:53.346243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:53.356419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7dc8db0c-e81a-4ea2-8be7-9ea2ee0c49d6 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.517364 Sep 15 12:24:53.360618 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 55/97] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:52 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:53.373815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:53.376779 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:53.386502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:53.387255 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:53.387866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:53.388848 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:53.391774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:53.392451 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:53.422785 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:53.431752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bf03ca50-f70d-4c08-96d5-14a1a0f996df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.608752 Sep 15 12:24:53.436450 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 43/98] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:52 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:53.442560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:53.443283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:53.471465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:53.472207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:53.472682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:53.473867 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:53.475225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:53.476321 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:53.729083 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:53.735261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:53.747530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-efe8f050-cabb-42cf-8bba-29d3096d020e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.384386 Sep 15 12:24:53.748124 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 56/99] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:53 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:53.752119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:53.755284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:53.761361 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b9f217e5-1abc-4b82-a3dc-ca61f3f48186 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.320132 Sep 15 12:24:53.773310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 44/100] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:53 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:54.260597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-6aecc58e-7220-4cf3-906c-fb14e8ff18ef req-e74f211c-57d3-4e68-901b-e6c07bd73137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2bf7f9-471f-4d81-8def-0d99339b2002", "name": "network-vif-plugged", "status": "completed", "tag": "c93f975d-2440-49cf-8c83-705154f8f455"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:54.282244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6aecc58e-7220-4cf3-906c-fb14e8ff18ef req-e74f211c-57d3-4e68-901b-e6c07bd73137 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.282728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6aecc58e-7220-4cf3-906c-fb14e8ff18ef req-e74f211c-57d3-4e68-901b-e6c07bd73137 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.283395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6aecc58e-7220-4cf3-906c-fb14e8ff18ef req-e74f211c-57d3-4e68-901b-e6c07bd73137 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.313922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-6aecc58e-7220-4cf3-906c-fb14e8ff18ef req-e74f211c-57d3-4e68-901b-e6c07bd73137 service nova] Creating event network-vif-plugged:c93f975d-2440-49cf-8c83-705154f8f455 for instance cf2bf7f9-471f-4d81-8def-0d99339b2002 on hv-cinder-85083 Sep 15 12:24:54.319289 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-6aecc58e-7220-4cf3-906c-fb14e8ff18ef req-e74f211c-57d3-4e68-901b-e6c07bd73137 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187139 Sep 15 12:24:54.326207 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 57/101] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:24:54.388038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:54.388910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:54.397306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.398229 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.398883 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.399761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.400478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.401122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.470886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:54.473975 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:54.481700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.482727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.483175 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.484026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.484528 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.484981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.711889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:54.720077 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8c49242d-c8ac-4dd4-9ff4-257d1bdb074f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.340860 Sep 15 12:24:54.721048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 45/102] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:54 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:54.771452 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:54.772050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:54.772708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:54.778424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.778905 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.779325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.780041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.780653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.781098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.782056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f09a85f9-859f-488a-945d-64f6e48695f9 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.321690 Sep 15 12:24:54.782634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 58/103] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:54 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:54.803579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:54.809371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:54.820328 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.820894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.821340 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:54.822049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:54.822559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:54.823056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:55.015634 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:55.026290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3d40f271-c8ea-426e-9cec-a04aabb02bfb tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.258741 Sep 15 12:24:55.027097 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 46/104] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:54 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:55.050328 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:55.062708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:55.065112 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:55.066887 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-744a515f-30a2-4c26-9c3c-39ef2ccb2077 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.272929 Sep 15 12:24:55.068026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 59/105] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:54 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:55.745882 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:55.747048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:55.756924 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:55.760807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:55.761793 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:55.762878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:55.763359 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:55.763771 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:55.807121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:55.807746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:55.818143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:55.818633 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:55.819070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:55.819767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:55.820220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:55.820708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:56.140302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:56.150327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1f0e488c-e3bf-4dae-ad77-ab02028e57ec tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.410695 Sep 15 12:24:56.150916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 47/106] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:55 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:56.155473 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:56.166444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e7829f54-ef70-4326-83a9-d2e66822e039 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.365097 Sep 15 12:24:56.167627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 60/107] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:55 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:56.172888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:56.173463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:56.174433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:56.175252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:56.179916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:56.180648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:56.181213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:56.182093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:56.182982 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:56.183693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:56.186747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:56.187480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:56.187908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:56.188809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:56.189271 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:56.189819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:56.477014 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:56.481408 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:56.486144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:56.487600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:56.488747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-031c8e6d-3270-40ee-8173-62f146f72b8c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.319919 Sep 15 12:24:56.489554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 61/108] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:56 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:56.493778 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-f79c2808-8093-4197-9a16-504ac3965db8 req-b94810b7-c5dc-49ab-9dc1-108f193290e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4481d43d-2a44-4a3c-b167-2b99e195a673", "name": "network-vif-plugged", "status": "completed", "tag": "7faf28c3-337f-487f-9e4b-3dc169341cac"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:56.499925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c43c8770-a758-41b1-b108-e1b22a4bd149 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.333015 Sep 15 12:24:56.501702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 48/109] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:56 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:56.507341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-f79c2808-8093-4197-9a16-504ac3965db8 req-b94810b7-c5dc-49ab-9dc1-108f193290e2 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:56.507341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-f79c2808-8093-4197-9a16-504ac3965db8 req-b94810b7-c5dc-49ab-9dc1-108f193290e2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:56.507341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-f79c2808-8093-4197-9a16-504ac3965db8 req-b94810b7-c5dc-49ab-9dc1-108f193290e2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:56.517187 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-f79c2808-8093-4197-9a16-504ac3965db8 req-b94810b7-c5dc-49ab-9dc1-108f193290e2 service nova] Creating event network-vif-plugged:7faf28c3-337f-487f-9e4b-3dc169341cac for instance 4481d43d-2a44-4a3c-b167-2b99e195a673 on hv-cinder-85083 Sep 15 12:24:56.522074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-f79c2808-8093-4197-9a16-504ac3965db8 req-b94810b7-c5dc-49ab-9dc1-108f193290e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Sep 15 12:24:56.522685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 62/110] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:57.178154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:57.178726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:57.189262 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.189755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.190185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.190888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.191325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.191742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.195769 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:57.196505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:57.207457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.207870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.219465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.221244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.221748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.222193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.389457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:57.553025 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:57.561931 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e8e7c134-ac2f-4b38-b63d-e378fb14322d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1314 microversion: 2.1 time: 0.387700 Sep 15 12:24:57.570321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:57.573431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 49/111] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:57 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:57.589945 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:57.590449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:57.623296 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a10c2bb3-2cb2-48db-a6ce-1b77deb8f663 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1363 microversion: 2.1 time: 0.429989 Sep 15 12:24:57.626097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 63/112] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:57 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:57.635315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.636282 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.636736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.637558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:57.639247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.639539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:57.640194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.657109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.660617 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.663254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.664021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.665557 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:57.666019 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:57.668951 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:57.940709 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:57.945286 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:57.956461 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f3fe5fae-bdee-44d7-8339-e554f950c62a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.328323 Sep 15 12:24:57.956560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:57.958505 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:57.959802 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 64/113] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:57 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:57.963659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-cff308e8-a191-4c62-9d43-16e1d727b1f2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.388947 Sep 15 12:24:57.964605 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 50/114] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:57 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:24:58.537214 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-fb264cdc-889d-4347-90c6-7c1af6cb4af2 req-61b74dc8-a578-4616-b749-160c43175aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "name": "network-vif-plugged", "status": "completed", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:24:58.547680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-fb264cdc-889d-4347-90c6-7c1af6cb4af2 req-61b74dc8-a578-4616-b749-160c43175aad service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.548150 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-fb264cdc-889d-4347-90c6-7c1af6cb4af2 req-61b74dc8-a578-4616-b749-160c43175aad service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.548583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-fb264cdc-889d-4347-90c6-7c1af6cb4af2 req-61b74dc8-a578-4616-b749-160c43175aad service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.560493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-fb264cdc-889d-4347-90c6-7c1af6cb4af2 req-61b74dc8-a578-4616-b749-160c43175aad service nova] Creating event network-vif-plugged:d1879643-5968-44a1-9897-dfed95801b5f for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 on hv-cinder-85083 Sep 15 12:24:58.565928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-fb264cdc-889d-4347-90c6-7c1af6cb4af2 req-61b74dc8-a578-4616-b749-160c43175aad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Sep 15 12:24:58.566581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 65/115] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:58.589674 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:58.591980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:58.619303 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.621328 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.621930 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.624350 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.625007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.626944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.650395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:58.651101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:58.665186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.666731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.667764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.669650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.670766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.672501 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.699760 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=100 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:58.932470 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:58.939705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:58.944780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-26e0d422-8b02-4d72-b25b-a6022e708030 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1549 microversion: 2.1 time: 0.300208 Sep 15 12:24:58.946171 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 66/116] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:58 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1549 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:58.947552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-00cdd4c5-badc-4a07-9dd9-9a345e706af4 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1501 microversion: 2.1 time: 0.362232 Sep 15 12:24:58.948133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 51/117] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:58 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:24:58.971119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:58.971810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:58.981751 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.982240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.982675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.983364 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:58.983500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:58.984017 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:58.984215 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:58.984875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:58.999888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:59.001823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:59.005107 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:59.005685 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:59.006034 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:59.006455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:59.234796 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-582cc91d-7b32-4aad-9f08-49808a8b4248 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268317 Sep 15 12:24:59.244689 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 67/118] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:24:58 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:24:59.250140 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:24:59.250852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:24:59.264964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:59.265595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:59.266153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:59.272349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:24:59.273409 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:24:59.274637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:24:59.317836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:59.335389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-166fa9e0-5a52-42b1-8fe5-3e5c82c67dfe tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.356364 Sep 15 12:24:59.336177 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 52/119] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:24:58 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:24:59.646502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:59.656661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:59.663542 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:24:59.665189 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-706b2fd3-29d8-4fef-a737-fb2894be8f0f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1408 microversion: 2.20 time: 0.419106 Sep 15 12:24:59.680538 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 68/120] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:24:59 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:25:00.370048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:00.372213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:00.399569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.401484 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.402737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.405760 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.407634 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.408514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.458711 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=100 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:00.583256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-a2322355-2f55-486f-9679-925661b7f744 req-91968986-35d1-49a1-9458-d0b95c5d4a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3545e504-2e9b-41e0-903c-f58ab4aa380a", "name": "network-vif-plugged", "status": "completed", "tag": "0116ca70-581b-40a9-8ad0-31dbb2d532e7"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:00.597496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-a2322355-2f55-486f-9679-925661b7f744 req-91968986-35d1-49a1-9458-d0b95c5d4a43 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.605013 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-a2322355-2f55-486f-9679-925661b7f744 req-91968986-35d1-49a1-9458-d0b95c5d4a43 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.605730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-a2322355-2f55-486f-9679-925661b7f744 req-91968986-35d1-49a1-9458-d0b95c5d4a43 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.629280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:00.637234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-a2322355-2f55-486f-9679-925661b7f744 req-91968986-35d1-49a1-9458-d0b95c5d4a43 service nova] Creating event network-vif-plugged:0116ca70-581b-40a9-8ad0-31dbb2d532e7 for instance 3545e504-2e9b-41e0-903c-f58ab4aa380a on hv-cinder-85083 Sep 15 12:25:00.640714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-13fc4331-47fc-41ab-85e4-6c9c37786802 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.282682 Sep 15 12:25:00.641575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 53/121] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:00 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:00.655229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-a2322355-2f55-486f-9679-925661b7f744 req-91968986-35d1-49a1-9458-d0b95c5d4a43 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075953 Sep 15 12:25:00.655827 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 69/122] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:25:00.686777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8c0f932-9704-4410-9407-353b134d9a51"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:00.696626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:00.697599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:00.701126 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:00.714597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.717053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.718511 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.719432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.721433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.723086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.724045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.725254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.727272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:00.728348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.730672 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:00.731394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:00.962833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:00.982203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:00.983834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:00.986038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0acf3493-7fb5-4423-b676-42ec7d9d7297 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1600 microversion: 2.20 time: 0.295413 Sep 15 12:25:00.988874 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 70/123] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:25:00 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1600 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:25:01.013955 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:01.014662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:01.021045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:01.022218 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:01.023368 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:01.024556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:01.025645 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:01.028987 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:01.122702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-89ee6d85-be76-43d0-be9f-c97b7093964e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112367 Sep 15 12:25:01.123324 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 71/124] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Sep 15 12:25:01 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:25:01.229207 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-ee1941f0-c9ad-4e80-aa17-f67ecfedbe5c req-0c65911a-c7d3-49d9-940c-e5f670dd277b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4481d43d-2a44-4a3c-b167-2b99e195a673", "tag": "7faf28c3-337f-487f-9e4b-3dc169341cac"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:01.242271 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-ee1941f0-c9ad-4e80-aa17-f67ecfedbe5c req-0c65911a-c7d3-49d9-940c-e5f670dd277b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:01.242801 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-ee1941f0-c9ad-4e80-aa17-f67ecfedbe5c req-0c65911a-c7d3-49d9-940c-e5f670dd277b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:01.243453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-ee1941f0-c9ad-4e80-aa17-f67ecfedbe5c req-0c65911a-c7d3-49d9-940c-e5f670dd277b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:01.281426 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-ee1941f0-c9ad-4e80-aa17-f67ecfedbe5c req-0c65911a-c7d3-49d9-940c-e5f670dd277b service nova] Creating event network-changed:7faf28c3-337f-487f-9e4b-3dc169341cac for instance 4481d43d-2a44-4a3c-b167-2b99e195a673 on hv-cinder-85083 Sep 15 12:25:01.294353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-ee1941f0-c9ad-4e80-aa17-f67ecfedbe5c req-0c65911a-c7d3-49d9-940c-e5f670dd277b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069639 Sep 15 12:25:01.295118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 72/125] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:25:01.667349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:01.668041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:01.674792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:01.675266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:01.677671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:01.679101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:01.679542 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:01.680020 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:02.078474 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:02.089632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d7ed8143-7157-436c-8bfb-d6a88d200afa tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.426441 Sep 15 12:25:02.092199 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 73/126] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:01 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:25:03.118627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:03.120038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:03.127002 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:03.127804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:03.128389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:03.129519 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:03.130298 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:03.130866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:03.312929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:03.325175 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d2870f8b-3f2a-4b1d-815e-754be6633b7d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.210662 Sep 15 12:25:03.326094 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 74/127] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:03 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:25:03.471287 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-c8c00814-fdfe-43e9-ad55-8000b4a87d34 req-a856ff98-2ee9-49dd-aea6-2e422d35cb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:03.498812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-c8c00814-fdfe-43e9-ad55-8000b4a87d34 req-a856ff98-2ee9-49dd-aea6-2e422d35cb17 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:03.499854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-c8c00814-fdfe-43e9-ad55-8000b4a87d34 req-a856ff98-2ee9-49dd-aea6-2e422d35cb17 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:03.500580 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-c8c00814-fdfe-43e9-ad55-8000b4a87d34 req-a856ff98-2ee9-49dd-aea6-2e422d35cb17 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:03.515604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-42484946-6789-407d-bcd5-198573d61386 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "POST /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.833073 Sep 15 12:25:03.531054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 54/128] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:25:00 2022] POST /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002/os-volume_attachments => generated 194 bytes in 2850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:03.558914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-c8c00814-fdfe-43e9-ad55-8000b4a87d34 req-a856ff98-2ee9-49dd-aea6-2e422d35cb17 service nova] Creating event network-changed:d1879643-5968-44a1-9897-dfed95801b5f for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 on hv-cinder-85083 Sep 15 12:25:03.565530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-c8c00814-fdfe-43e9-ad55-8000b4a87d34 req-a856ff98-2ee9-49dd-aea6-2e422d35cb17 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237622 Sep 15 12:25:03.566377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 75/129] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:04.351439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:04.352725 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:04.359384 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:04.359814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:04.360260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:04.360990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:04.361443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:04.361864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:04.511666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:04.519102 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-898859ce-b9fa-421e-8c91-676696a32483 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.172674 Sep 15 12:25:04.519680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 55/130] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:04 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:05.543509 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:05.544133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:05.550464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:05.550971 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:05.551401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:05.552074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:05.552518 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:05.552960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:05.851233 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:05.859435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d2cad0a0-084b-4e3f-85f0-50495b3a19c4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.320639 Sep 15 12:25:05.860001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 76/131] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:05 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:06.882219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:06.882837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:06.889531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:06.890071 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:06.891221 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:06.892032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:06.892455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:06.893139 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:07.029255 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:07.036871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-47d8752a-cdc9-4d09-b9ae-59821abbf536 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.158507 Sep 15 12:25:07.037437 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 56/132] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:06 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:08.060591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:08.061234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:08.070420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:08.070923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:08.071971 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:08.072679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:08.073192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:08.073622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:08.293607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:08.303460 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8ca519ef-9271-492b-a09c-5cd9296837b3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1364 microversion: 2.1 time: 0.246639 Sep 15 12:25:08.304195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 77/133] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:08 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:09.331880 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:09.332491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:09.340168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:09.340655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:09.341115 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:09.341805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:09.342258 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:09.342680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:09.505041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:09.515124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3736de23-e1c4-44bb-892e-120306adef14 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1554 microversion: 2.1 time: 0.187393 Sep 15 12:25:09.515702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 57/134] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:09 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:09.541093 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:09.541723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:09.548658 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:09.549466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:09.550157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:09.550908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:09.551554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:09.552074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:09.636228 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-97c0247b-4125-4a45-9aaa-dfd3f05a2a39 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100041 Sep 15 12:25:09.640548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 78/135] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:25:09 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:11.122407 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-ceea871b-40da-42d7-8a4b-fc12e4d370b6 req-04527a00-3f1a-4d02-9294-fe2fee606d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3545e504-2e9b-41e0-903c-f58ab4aa380a", "tag": "0116ca70-581b-40a9-8ad0-31dbb2d532e7"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:11.141274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-ceea871b-40da-42d7-8a4b-fc12e4d370b6 req-04527a00-3f1a-4d02-9294-fe2fee606d2b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:11.142010 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-ceea871b-40da-42d7-8a4b-fc12e4d370b6 req-04527a00-3f1a-4d02-9294-fe2fee606d2b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:11.142657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-ceea871b-40da-42d7-8a4b-fc12e4d370b6 req-04527a00-3f1a-4d02-9294-fe2fee606d2b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:11.161356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-ceea871b-40da-42d7-8a4b-fc12e4d370b6 req-04527a00-3f1a-4d02-9294-fe2fee606d2b service nova] Creating event network-changed:0116ca70-581b-40a9-8ad0-31dbb2d532e7 for instance 3545e504-2e9b-41e0-903c-f58ab4aa380a on hv-cinder-85083 Sep 15 12:25:11.169736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-ceea871b-40da-42d7-8a4b-fc12e4d370b6 req-04527a00-3f1a-4d02-9294-fe2fee606d2b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050992 Sep 15 12:25:11.171055 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 58/136] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:18.701860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:18.702392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:18.709737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:18.710226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:18.710660 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:18.718062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:18.718820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:18.719263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:18.757615 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:25:18.864098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-33b83e91-7e2d-4fe3-bb4c-c553c24c356f tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 204 len: 0 microversion: 2.1 time: 0.167901 Sep 15 12:25:18.864976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 79/137] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:25:18 2022] DELETE /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:25:18.874137 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:18.874846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:18.877075 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=49 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:18.882295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:18.882989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:18.883427 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:18.884130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:18.884743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:18.885787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:19.078161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:19.089620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7589afaa-6691-463b-904c-53bdd0b05c42 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1553 microversion: 2.1 time: 0.220481 Sep 15 12:25:19.090606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 59/138] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:18 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:20.114576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:20.115384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:20.121950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:20.122430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:20.122889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:20.123640 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:20.124074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:20.124496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:20.259957 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:20.268676 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cc55f8e2-8157-4d40-bdb9-05bc19c5e99d tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1553 microversion: 2.1 time: 0.158170 Sep 15 12:25:20.269358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 80/139] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:20 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:21.293222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:21.294159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:21.307023 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:21.311308 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:21.311753 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:21.312464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:21.312983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:21.315277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:21.554889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:21.564770 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-954c1e08-18c0-4717-8801-7b5a289bdeac tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1553 microversion: 2.1 time: 0.276507 Sep 15 12:25:21.565855 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 60/140] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:21 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:21.876524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-54fec543-3afc-49dc-92e2-68729e85547e req-7a0fe1ea-dc58-4b89-ac73-01beab8b9101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2bf7f9-471f-4d81-8def-0d99339b2002", "name": "network-vif-deleted", "tag": "c93f975d-2440-49cf-8c83-705154f8f455"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:21.892154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:21.894559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-54fec543-3afc-49dc-92e2-68729e85547e req-7a0fe1ea-dc58-4b89-ac73-01beab8b9101 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:21.895224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-54fec543-3afc-49dc-92e2-68729e85547e req-7a0fe1ea-dc58-4b89-ac73-01beab8b9101 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:21.895888 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-54fec543-3afc-49dc-92e2-68729e85547e req-7a0fe1ea-dc58-4b89-ac73-01beab8b9101 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:21.924466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-54fec543-3afc-49dc-92e2-68729e85547e req-7a0fe1ea-dc58-4b89-ac73-01beab8b9101 service nova] Creating event network-vif-deleted:c93f975d-2440-49cf-8c83-705154f8f455 for instance cf2bf7f9-471f-4d81-8def-0d99339b2002 on hv-cinder-85083 Sep 15 12:25:21.931038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-54fec543-3afc-49dc-92e2-68729e85547e req-7a0fe1ea-dc58-4b89-ac73-01beab8b9101 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057873 Sep 15 12:25:21.932405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 81/141] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:22.589151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:22.590513 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:22.599940 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:22.600577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:22.601241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:22.602221 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:22.603139 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:22.603572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:22.651600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:22.651960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:22.652392 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:22.652940 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lazy-loading 'fault' on Instance uuid cf2bf7f9-471f-4d81-8def-0d99339b2002 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:25:22.699820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c77cfb2ad8404f9d0dff4f9bdb98ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705a7022acf04881bed0e40d7a491dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:22.711671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8e0f69a7-55c2-41f7-8a6c-86e4dba1d727 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 200 len: 1350 microversion: 2.1 time: 0.128142 Sep 15 12:25:22.712334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 61/142] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:22 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:23.738166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:23.738860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:23.745268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:23.745746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:23.746283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:23.747268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:23.748055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:23.748646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:23.763802 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] HTTP exception thrown: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Request method failure captured: Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 HTTP/1.1 Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxlymxs3y3NqFI4p2cSPvhjhkynAz4JNH91YA6kscz6j4F0H9BKpZH24pjyUyHOJnxr936Ze9iuHrWPSc6bWmOv7ysaDBCBMCJHytqj5haBMmEtvRYTJDYiQ7fFPfuRvXUlhG1fXS84XuKiyp8i5mrc1uDtUBqES3fqVCt-EyKyQhUI Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:25:23.768362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: b5c77cfb2ad8404f9d0dff4f9bdb98ba Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.769844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'cf2bf7f9-471f-4d81-8def-0d99339b2002'} Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:25:23.770701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.772211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.773229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Returning 404 to user: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:25:23.773229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d9816dfa-80e0-4313-bccd-b49cf86a7566 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 404 len: 111 microversion: 2.1 time: 0.036441 Sep 15 12:25:23.773229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 82/143] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:23 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:25:23.883899 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:23.886596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:23.895707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:23.896427 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:23.896881 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:23.897934 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:23.899025 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:23.900349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:23.916644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] HTTP exception thrown: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Request method failure captured: Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002/os-volume_attachments HTTP/1.1 Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxlymxs3y3NqFI4p2cSPvhjhkynAz4JNH91YA6kscz6j4F0H9BKpZH24pjyUyHOJnxr936Ze9iuHrWPSc6bWmOv7ysaDBCBMCJHytqj5haBMmEtvRYTJDYiQ7fFPfuRvXUlhG1fXS84XuKiyp8i5mrc1uDtUBqES3fqVCt-EyKyQhUI Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:25:23.920973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: b5c77cfb2ad8404f9d0dff4f9bdb98ba Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.922147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'server_id': 'cf2bf7f9-471f-4d81-8def-0d99339b2002'} Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:25:23.922786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:23.923853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:23.925086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Returning 404 to user: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:25:23.925086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-48563f4c-cc09-4bbd-ac7c-ef3fb9d2e3a1 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043454 Sep 15 12:25:23.925086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 62/144] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:25:23 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:25:27.282517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:27.283102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:27.288934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:27.289421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:27.289860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:27.290623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:27.291338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:27.291701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:27.305644 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] HTTP exception thrown: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Request method failure captured: Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 HTTP/1.1 Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxlymxs3y3NqFI4p2cSPvhjhkynAz4JNH91YA6kscz6j4F0H9BKpZH24pjyUyHOJnxr936Ze9iuHrWPSc6bWmOv7ysaDBCBMCJHytqj5haBMmEtvRYTJDYiQ7fFPfuRvXUlhG1fXS84XuKiyp8i5mrc1uDtUBqES3fqVCt-EyKyQhUI Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:25:27.307924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: b5c77cfb2ad8404f9d0dff4f9bdb98ba Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.309507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'cf2bf7f9-471f-4d81-8def-0d99339b2002'} Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:25:27.310349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.311879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.313967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Returning 404 to user: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:25:27.314821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9b1f5554-7482-4d02-8984-b680168fa857 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 404 len: 111 microversion: 2.1 time: 0.036184 Sep 15 12:25:27.315548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 83/145] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:25:27 2022] DELETE /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:25:27.324632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:27.325463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] [instance: cf2bf7f9-471f-4d81-8def-0d99339b2002] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:27.333314 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:27.333871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:27.334414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:27.335179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:27.335715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:27.336214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:27.351842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] HTTP exception thrown: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Request method failure captured: Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 HTTP/1.1 Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxlymxs3y3NqFI4p2cSPvhjhkynAz4JNH91YA6kscz6j4F0H9BKpZH24pjyUyHOJnxr936Ze9iuHrWPSc6bWmOv7ysaDBCBMCJHytqj5haBMmEtvRYTJDYiQ7fFPfuRvXUlhG1fXS84XuKiyp8i5mrc1uDtUBqES3fqVCt-EyKyQhUI Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:25:27.354148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/705a7022acf04881bed0e40d7a491dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 705a7022acf04881bed0e40d7a491dd4 Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-DeleteServersTestJSON-78998594 Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: b5c77cfb2ad8404f9d0dff4f9bdb98ba Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-DeleteServersTestJSON-78998594-project Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'cf2bf7f9-471f-4d81-8def-0d99339b2002'} Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:25:27.356410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. Sep 15 12:25:27.358292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:25:27.359847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] Returning 404 to user: Instance cf2bf7f9-471f-4d81-8def-0d99339b2002 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:25:27.359847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-86ce9c8a-7832-4436-ac2a-a9dff36592f2 tempest-DeleteServersTestJSON-78998594 tempest-DeleteServersTestJSON-78998594-project] 10.222.0.15 "GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002" status: 404 len: 111 microversion: 2.1 time: 0.036197 Sep 15 12:25:27.359847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 63/146] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:27 2022] GET /compute/v2.1/servers/cf2bf7f9-471f-4d81-8def-0d99339b2002 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:25:37.844736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=5 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:37.845648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:38.138846 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-532853269", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:43.201541 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] validate_networks() for [('0b134910-e426-40c5-a85a-f1e6c6e22348', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:25:43.594571 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:25:43.595507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:25:43.595985 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:25:43.596471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:25:43.596819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:25:43.610678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:43.611459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:43.612274 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:43.613260 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:43.613829 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:43.614446 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:43.632655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for project 22801aa5908b4b098931d2588433e9db. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:25:43.636947 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for user 20ca976222454c6c898d0e4b170b41fc and project 22801aa5908b4b098931d2588433e9db. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:25:43.647871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:25:43.650167 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:25:43.699601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-caff5a05-1747-4968-a205-ca2fb8042d9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.862147 Sep 15 12:25:43.700574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 84/147] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:25:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 5864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:25:43.713256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a3c180cb-4b96-4123-b0ce-540c9f491a3d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:43.714983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a3c180cb-4b96-4123-b0ce-540c9f491a3d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:43.725265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=11 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:43.726251 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:43.789976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a3c180cb-4b96-4123-b0ce-540c9f491a3d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:43.797840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a3c180cb-4b96-4123-b0ce-540c9f491a3d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1221 microversion: 2.1 time: 0.090276 Sep 15 12:25:43.798486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 64/148] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:43 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:43.960524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-839733131", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:44.029056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] validate_networks() for [('0b134910-e426-40c5-a85a-f1e6c6e22348', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:25:44.444505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:25:44.445090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:25:44.445601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:25:44.446167 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:25:44.447224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:25:44.458680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:44.459161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:44.459787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:44.460500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:44.460974 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:44.461390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:44.480743 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for project 22801aa5908b4b098931d2588433e9db. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:25:44.484675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for user 20ca976222454c6c898d0e4b170b41fc and project 22801aa5908b4b098931d2588433e9db. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:25:44.496579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:25:44.498802 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:25:44.544578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-559cf8d7-02ca-412f-b729-a8642b2cf642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.594883 Sep 15 12:25:44.545261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 85/149] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:25:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:25:44.556831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ce5350cf-2b8f-4639-be66-3117e6e3ad77 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:44.557444 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ce5350cf-2b8f-4639-be66-3117e6e3ad77 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:44.613495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ce5350cf-2b8f-4639-be66-3117e6e3ad77 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:44.621509 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ce5350cf-2b8f-4639-be66-3117e6e3ad77 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1221 microversion: 2.1 time: 0.069143 Sep 15 12:25:44.622070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 65/150] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:44 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:45.646326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:45.647185 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:45.656736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:45.657574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:45.658393 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:45.659486 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:45.660301 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:45.661691 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:45.753689 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:45.761994 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-bf30a22f-f0f7-40c0-aa59-16ea4f0a5ec4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1273 microversion: 2.1 time: 0.120003 Sep 15 12:25:45.762670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 86/151] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:45 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:46.787817 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:46.789191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:46.798203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:46.798695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:46.799233 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:46.799938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:46.800478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:46.800936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:46.910765 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:46.920424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-98f1e9ee-0f94-4573-8baf-213f8a0928ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1279 microversion: 2.1 time: 0.136717 Sep 15 12:25:46.921052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 66/152] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:46 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:46.987509 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-76d7c0a2-2a99-45ee-bcd6-bc3444aee467 req-94198fe0-f9da-4138-9ba6-54f45f004187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549690bd-637f-4b47-a149-1ccc7f45ec42", "tag": "7fcd7e64-3ffd-4be7-bb28-45dbf4a74121"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:47.003157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-76d7c0a2-2a99-45ee-bcd6-bc3444aee467 req-94198fe0-f9da-4138-9ba6-54f45f004187 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:47.004423 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-76d7c0a2-2a99-45ee-bcd6-bc3444aee467 req-94198fe0-f9da-4138-9ba6-54f45f004187 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:47.007694 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-76d7c0a2-2a99-45ee-bcd6-bc3444aee467 req-94198fe0-f9da-4138-9ba6-54f45f004187 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:47.027369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-76d7c0a2-2a99-45ee-bcd6-bc3444aee467 req-94198fe0-f9da-4138-9ba6-54f45f004187 service nova] Creating event network-changed:7fcd7e64-3ffd-4be7-bb28-45dbf4a74121 for instance 549690bd-637f-4b47-a149-1ccc7f45ec42 on hv-cinder-85083 Sep 15 12:25:47.035242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-76d7c0a2-2a99-45ee-bcd6-bc3444aee467 req-94198fe0-f9da-4138-9ba6-54f45f004187 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054206 Sep 15 12:25:47.036184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 87/153] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:47.945169 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:47.945785 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:47.953057 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:47.962468 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:47.962938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:47.963686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:47.964214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:47.964671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:48.119701 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:48.128039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1f999ccf-fdd1-497b-b68d-46217b2b78d4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.186711 Sep 15 12:25:48.128615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 67/154] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:47 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:49.085300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-076e0184-5e3b-4673-aef0-8780cb7bd001 req-24e9b9d2-09f6-41ec-86b4-a7b5343fdf5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57deea25-f70f-4879-aa0d-f5d8cd294e53", "tag": "cae77bb3-253f-485f-9be4-52543bc8042a"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:49.097664 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-076e0184-5e3b-4673-aef0-8780cb7bd001 req-24e9b9d2-09f6-41ec-86b4-a7b5343fdf5b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:49.098466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-076e0184-5e3b-4673-aef0-8780cb7bd001 req-24e9b9d2-09f6-41ec-86b4-a7b5343fdf5b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:49.111332 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-076e0184-5e3b-4673-aef0-8780cb7bd001 req-24e9b9d2-09f6-41ec-86b4-a7b5343fdf5b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:49.135776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-076e0184-5e3b-4673-aef0-8780cb7bd001 req-24e9b9d2-09f6-41ec-86b4-a7b5343fdf5b service nova] Creating event network-changed:cae77bb3-253f-485f-9be4-52543bc8042a for instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 on hv-cinder-85083 Sep 15 12:25:49.141202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-076e0184-5e3b-4673-aef0-8780cb7bd001 req-24e9b9d2-09f6-41ec-86b4-a7b5343fdf5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059495 Sep 15 12:25:49.141816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 88/155] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:49.158514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:49.161540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:49.168097 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:49.168334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:49.168714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:49.169689 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:49.169907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:49.170332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:49.303218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:49.311313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-38db4dae-3ae6-4b23-a8cb-cb9f893362e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.164165 Sep 15 12:25:49.311887 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 68/156] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:49 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:50.338815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:50.339682 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:50.346240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:50.346723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:50.347153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:50.347833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:50.348282 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:50.348705 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:50.492624 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:50.501283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b76ab8a2-d1ed-4b5f-8e6d-10d79594fd79 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.166516 Sep 15 12:25:50.501854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 89/157] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:50 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:51.525447 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:51.526087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:51.532768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:51.533270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:51.533705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:51.534410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:51.534862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:51.535287 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:51.675322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:51.684387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b6ff950e-be2e-4952-8e5e-d0e1b6495543 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.162881 Sep 15 12:25:51.685070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 69/158] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:51 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:51.778901 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-f8d0486b-0d15-4f90-82c2-5dae861f5864 req-77d44e1e-6f76-4868-8ce5-9edfd50c0dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549690bd-637f-4b47-a149-1ccc7f45ec42", "name": "network-vif-plugged", "status": "completed", "tag": "7fcd7e64-3ffd-4be7-bb28-45dbf4a74121"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:51.806187 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-f8d0486b-0d15-4f90-82c2-5dae861f5864 req-77d44e1e-6f76-4868-8ce5-9edfd50c0dc4 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:51.807810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-f8d0486b-0d15-4f90-82c2-5dae861f5864 req-77d44e1e-6f76-4868-8ce5-9edfd50c0dc4 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:51.808254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-f8d0486b-0d15-4f90-82c2-5dae861f5864 req-77d44e1e-6f76-4868-8ce5-9edfd50c0dc4 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:51.828220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-f8d0486b-0d15-4f90-82c2-5dae861f5864 req-77d44e1e-6f76-4868-8ce5-9edfd50c0dc4 service nova] Creating event network-vif-plugged:7fcd7e64-3ffd-4be7-bb28-45dbf4a74121 for instance 549690bd-637f-4b47-a149-1ccc7f45ec42 on hv-cinder-85083 Sep 15 12:25:51.832969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-f8d0486b-0d15-4f90-82c2-5dae861f5864 req-77d44e1e-6f76-4868-8ce5-9edfd50c0dc4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057991 Sep 15 12:25:51.833687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 90/159] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:52.707079 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:52.707691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:52.714759 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:52.715234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:52.715699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:52.716379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:52.716862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:52.717284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:52.848510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:52.856136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-939131a8-b01a-4572-9357-31affbc5f11a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.152901 Sep 15 12:25:52.856692 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 70/160] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:52 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:53.878825 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:53.879529 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:53.886115 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:53.886586 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:53.887012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:53.887684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:53.888125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:53.888541 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:54.018005 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:54.026544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-055708f3-9ec2-453d-aa0a-ff4df116fb5d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.151871 Sep 15 12:25:54.027112 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 91/161] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:53 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:55.049168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:55.049768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:55.053112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:55.058683 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:55.059155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:55.059580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:55.060250 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:55.060695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:55.061131 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:55.190051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:55.198592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-def4d627-d10d-4ecd-b6eb-b5b5e1f23770 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.153209 Sep 15 12:25:55.199167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 71/162] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:55 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:56.221617 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:56.222250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:56.224206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=4 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:56.225030 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=12 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:56.231599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:56.232081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:56.232517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:56.233226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:56.233681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:56.234106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:56.358114 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:56.365679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-35a51c47-8fe8-47f3-969c-a363c5091e0a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.148146 Sep 15 12:25:56.366254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 92/163] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:56 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:56.909890 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-b5a84942-b049-4666-8266-76ea8404a55f req-277056bf-0d0c-487f-b37d-c8312c50ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57deea25-f70f-4879-aa0d-f5d8cd294e53", "name": "network-vif-plugged", "status": "completed", "tag": "cae77bb3-253f-485f-9be4-52543bc8042a"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:56.920660 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b5a84942-b049-4666-8266-76ea8404a55f req-277056bf-0d0c-487f-b37d-c8312c50ccfa service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:56.921169 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b5a84942-b049-4666-8266-76ea8404a55f req-277056bf-0d0c-487f-b37d-c8312c50ccfa service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:56.921593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b5a84942-b049-4666-8266-76ea8404a55f req-277056bf-0d0c-487f-b37d-c8312c50ccfa service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:56.932606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-b5a84942-b049-4666-8266-76ea8404a55f req-277056bf-0d0c-487f-b37d-c8312c50ccfa service nova] Creating event network-vif-plugged:cae77bb3-253f-485f-9be4-52543bc8042a for instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 on hv-cinder-85083 Sep 15 12:25:56.937677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-b5a84942-b049-4666-8266-76ea8404a55f req-277056bf-0d0c-487f-b37d-c8312c50ccfa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Sep 15 12:25:56.938531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 72/164] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:57.146842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:57.147332 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:57.153696 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:57.154498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:57.155068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:57.155764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:57.156235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:57.156649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:57.179623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2ed53eaa-4667-4d19-97e5-6c42b12ee0f3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/ips" status: 200 len: 146 microversion: 2.1 time: 0.036534 Sep 15 12:25:57.180233 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 93/165] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:25:57 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:25:57.390620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:57.391249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:57.397363 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:57.397843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:57.398391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:57.399148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:57.399600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:57.400050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:57.527531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:57.535110 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8cbd3b1a-9de3-457c-9e4e-188ffd09f197 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.149370 Sep 15 12:25:57.535691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 73/166] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:57 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:58.559087 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:58.560263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:58.568232 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:58.568960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:58.569549 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:58.570494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:58.571812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:58.572560 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:58.712911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:58.720644 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-522091e4-0b06-44e4-a05c-5ba7e9bbff26 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1321 microversion: 2.1 time: 0.166658 Sep 15 12:25:58.721236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 94/167] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:58 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:58.759123 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:58.759616 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:58.765981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:58.766457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:58.766887 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:58.767571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:58.768019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:58.768439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:58.790975 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-79eea9e2-144c-4ebe-b7a0-5835e40a77af tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/ips" status: 200 len: 151 microversion: 2.20 time: 0.036351 Sep 15 12:25:58.791543 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 74/168] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Sep 15 12:25:58 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:25:59.743470 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:25:59.744081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:59.750818 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:59.751294 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:59.751717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:59.752399 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:59.752866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:59.753493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:59.893064 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:25:59.901569 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c9e0192e-5d49-421d-8a3f-18b4edc626e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1516 microversion: 2.1 time: 0.161319 Sep 15 12:25:59.902027 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 95/169] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:25:59 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:25:59.923566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:25:59.925918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:25:59.932242 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:59.932727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:59.933188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:59.933870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:25:59.934317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:25:59.934738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:25:59.961275 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'flavor' on Instance uuid 57deea25-f70f-4879-aa0d-f5d8cd294e53 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:26:00.084446 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-34b96119-782a-477c-9d5f-d37b08fd6941 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53/action" status: 200 len: 32 microversion: 2.1 time: 0.164819 Sep 15 12:26:00.085154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 75/170] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:25:59 2022] POST /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 12:26:00.102647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:00.103377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:00.110071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.110581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.111010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.111686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.112135 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.112552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.270871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:00.279608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0925bbb2-29a9-49e3-8576-ae9236a73d66 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.181252 Sep 15 12:26:00.293069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 96/171] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:00 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:00.377892 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b992a60-f863-4207-8b6d-bd8d77eebcbf"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:00.380675 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:00.390613 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.391255 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.391757 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.392455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.392947 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.393374 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.630103 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:00.630858 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:00.638336 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.639077 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.639488 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.640190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.640639 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.641107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.669295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-017d7046-804a-4f8c-b7ca-7fa68032ed1d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295872 Sep 15 12:26:00.669468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lazy-loading 'flavor' on Instance uuid ad7e2f44-79df-47c0-b85d-68b4b96e4590 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:26:00.670540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 76/172] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:26:00 2022] POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:26:00.939739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9e3b9aed-68d4-44c9-9215-afd5793436ff tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/action" status: 202 len: 0 microversion: 2.20 time: 0.314372 Sep 15 12:26:00.940323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 97/173] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 12:26:00 2022] POST /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 12:26:00.950474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:00.952019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:00.959564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.961634 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.962525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:00.963764 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:00.964211 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:00.964630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:01.149178 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:01.163806 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:01.167124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:01.169465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-808994e2-4132-4b61-beb0-fef248656ec2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.224334 Sep 15 12:26:01.170525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 77/174] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:00 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:01.304236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:01.305186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:01.312307 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:01.312821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:01.313295 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:01.313995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:01.314434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:01.314852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:01.494637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:01.506027 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6b16786c-8eda-4aaf-aeda-38f05effd68a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.205774 Sep 15 12:26:01.506671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 98/175] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:01 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:02.197225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:02.197834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:02.204094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:02.204568 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:02.205031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:02.205705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:02.206315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:02.206732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:02.340367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:02.360319 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:02.361808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:02.362981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b182a03a-d170-4f19-b38e-a22f92c609fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.170490 Sep 15 12:26:02.363820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 78/176] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:02 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:02.529278 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:02.529889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:02.535980 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:02.536459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:02.536931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:02.537613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:02.538061 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:02.538479 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:02.668092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:02.677407 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2a908e8d-700d-4fe5-af5e-31438762e685 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.152006 Sep 15 12:26:02.677967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 99/177] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:02 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:03.387949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:03.388488 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:03.395119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:03.395609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:03.396039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:03.396921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:03.397352 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:03.397778 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:03.537870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:03.546087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:03.547563 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:03.548730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e20b86f7-1171-474d-9c69-75bb49a979a6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.165254 Sep 15 12:26:03.549339 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 79/178] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:03 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:03.700240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:03.700998 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:03.707528 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:03.708179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:03.708493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:03.709267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:03.709702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:03.710126 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:03.851879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:03.861241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c1d5853d-e59e-474e-8005-ce81ffa70126 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.164727 Sep 15 12:26:03.861818 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 100/179] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:03 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:04.574841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:04.575444 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:04.581734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:04.582202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:04.582628 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:04.583297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:04.583736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:04.584150 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:04.588924 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:04.719136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:04.727048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:04.728478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:04.729659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ce42d8e6-f838-4d66-86f4-29fd4597f20f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.159303 Sep 15 12:26:04.730216 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 80/180] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:04 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:04.885225 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:04.885841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:04.891834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:04.892315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:04.892774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:04.893456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:04.893906 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:04.894324 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:05.022795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:05.031048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8a362b04-eb61-4223-86f7-fb411827a5b7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.151376 Sep 15 12:26:05.031735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 101/181] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:04 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:05.755265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:05.755909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:05.762933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:05.763411 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:05.763849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:05.764533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:05.765023 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:05.765449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:05.892817 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:05.901386 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:05.902813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:05.903966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1d9feb43-88ea-447b-a5df-5663917a8688 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.152559 Sep 15 12:26:05.904550 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 81/182] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:05 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:06.054278 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:06.054931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:06.060731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:06.061248 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:06.061679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:06.062363 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:06.062812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:06.063251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:06.068305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:06.179070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:06.179558 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:06.186594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:06.187378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:06.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:06.188488 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:06.188961 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:06.189374 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:06.195751 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:06.203930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3f5fdda6-9b8c-473d-8f5f-f9aa51f32d6e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.153531 Sep 15 12:26:06.204502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 102/183] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:06 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:06.213737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-686fef87-3bd0-4020-ab8a-3539bc923086 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/ips" status: 200 len: 150 microversion: 2.1 time: 0.038468 Sep 15 12:26:06.214291 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 82/184] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:26:06 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:26:06.928660 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:06.929365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:06.936459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:06.936974 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:06.937669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:06.938353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:06.938792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:06.939204 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:07.064976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:07.073385 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:07.075575 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:07.077323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-be7e6b64-5082-4114-a0a7-762da002caa7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.152557 Sep 15 12:26:07.078329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 103/185] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:06 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:07.227290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:07.227904 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:07.234963 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:07.235442 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:07.235879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:07.236562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:07.237046 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:07.237470 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:07.365673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:07.373479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ada7bf4a-3bf0-470b-87ef-55c4b81e8d06 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.150009 Sep 15 12:26:07.374048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 83/186] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:07 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:08.105496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:08.106110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:08.107985 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:08.113830 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:08.114306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:08.114741 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:08.115418 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:08.115866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:08.116285 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:08.246665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:08.254680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:08.256128 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:08.257322 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1972e9f5-7818-46d9-a14f-1413d7d0187d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.156319 Sep 15 12:26:08.257876 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 104/187] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:08 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:08.396316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:08.397040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:08.403375 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:08.403844 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:08.404266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:08.404980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:08.405425 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:08.405835 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:08.535061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:08.543306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-93ba7d68-4991-4bac-ba3a-1edcb2193448 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.150771 Sep 15 12:26:08.543874 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 84/188] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:08 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:09.287713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:09.288361 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:09.295175 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:09.296040 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:09.296740 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:09.297459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:09.297911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:09.298335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:09.424329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:09.432898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:09.434344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:09.435497 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c30a5367-1f10-49ea-9e6d-f099607f3e62 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.153773 Sep 15 12:26:09.436064 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 105/189] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:09 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:09.567061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:09.567605 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:09.574708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:09.575183 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:09.575613 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:09.576294 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:09.576742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:09.577187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:09.678854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a4a078-9aff-4666-9f9f-dc208ff70521"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:09.681929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:09.687845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:09.688323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:09.688803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:09.689462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:09.689912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:09.690331 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:09.712838 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:09.720919 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1549ef88-1bb6-4111-93fc-00c7ea3ee799 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.157636 Sep 15 12:26:09.721487 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 85/190] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:09 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:10.460929 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:10.461530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:10.468029 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:10.468472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:10.469191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:10.469865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:10.470306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:10.470724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:10.596715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:10.604621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:10.606091 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:10.607243 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2fdda07a-fc59-4d01-9578-fc81bc43e71c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.150218 Sep 15 12:26:10.607799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 86/191] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:10 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:10.743301 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:10.744345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:10.750214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:10.750694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:10.751128 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:10.751810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:10.752260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:10.752685 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:10.876742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:10.884961 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-30f85b8f-50d0-48a5-8400-aa3977d4f0d8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.144911 Sep 15 12:26:10.885534 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 87/192] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:10 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:11.632311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:11.632948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:11.639215 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:11.639690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:11.640114 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:11.640806 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:11.641254 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:11.641667 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:11.771565 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:11.780105 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:11.781593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:11.783045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5765705b-cd50-4f93-a610-82d3e7e77bfd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.154641 Sep 15 12:26:11.783607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 88/193] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:11 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:11.907460 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:11.907995 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:11.913946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:11.914428 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:11.914867 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:11.916097 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:11.916579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:11.917033 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:12.046737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:12.054327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7ff9f158-c5da-44a1-bdc1-04d497761642 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.150658 Sep 15 12:26:12.054889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 89/194] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:11 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:12.334496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-47218fd2-3bf8-47c1-9a30-8ef9ca6e0ba4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.659435 Sep 15 12:26:12.335723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 106/195] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:26:09 2022] POST /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments => generated 194 bytes in 2662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:26:12.501713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8891ab14-d67b-47dd-b69b-cf9922795e44 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:12.507607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8891ab14-d67b-47dd-b69b-cf9922795e44 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:12.508258 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8891ab14-d67b-47dd-b69b-cf9922795e44 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:12.508691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8891ab14-d67b-47dd-b69b-cf9922795e44 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:12.567843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8891ab14-d67b-47dd-b69b-cf9922795e44 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Going to try to stop instance {{(pid=120436) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 12:26:12.609790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8891ab14-d67b-47dd-b69b-cf9922795e44 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action" status: 202 len: 0 microversion: 2.1 time: 0.111714 Sep 15 12:26:12.610414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 90/196] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:26:12 2022] POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:26:12.618989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:12.619685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:12.626290 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:12.626763 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:12.627193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:12.627914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:12.628325 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:12.628789 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:12.760667 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:12.769025 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-79224aae-809c-4ccb-98f3-0d63c36acb2b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.154026 Sep 15 12:26:12.769588 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 107/197] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:12 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:12.809184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:12.810013 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:12.815967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:12.816448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:12.816915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:12.817596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:12.818044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:12.818465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:12.951617 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:12.959884 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:12.961294 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:12.962546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-af20bd31-3b95-4690-8be1-28e1af1869e7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.158032 Sep 15 12:26:12.963112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 91/198] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:12 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:13.078129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:13.078751 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:13.085093 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:13.085787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:13.086227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:13.086914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:13.087749 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:13.088161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:13.225405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:13.233136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5256b6d4-2b10-4d05-aa0f-abd6d031cf44 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.159177 Sep 15 12:26:13.233699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 108/199] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:13 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:13.793195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:13.793919 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:13.796219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=61 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:13.801457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:13.801940 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:13.802403 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:13.803164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:13.803621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:13.804045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:13.937641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:13.946082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-439ffe57-da0f-4295-8bd3-e892d9f1650e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.157495 Sep 15 12:26:13.946665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 92/200] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:13 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:13.987517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:13.988210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:13.994866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:13.995349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:13.995778 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:13.996461 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:13.997131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:13.997574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:14.128579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:14.138198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:14.139652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:14.140848 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4528dba7-1704-4ccb-8182-d74c99742015 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.157228 Sep 15 12:26:14.141417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 109/201] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:13 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:14.255454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:14.256065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:14.262101 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:14.262580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:14.263122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:14.263698 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:14.264142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:14.264557 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:14.396181 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:14.406146 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5410b784-bc81-4ffa-b847-69c11c4ba1bb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.154387 Sep 15 12:26:14.406725 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 93/202] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:14 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:14.969397 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:14.970017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:14.976308 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:14.976871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:14.977473 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:14.978182 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:14.978614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:14.979032 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:15.120294 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:15.128415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-66596946-d22e-416a-aed5-e50a7bf593f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.163154 Sep 15 12:26:15.128997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 110/203] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:14 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:15.166878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:15.167502 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:15.173911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:15.174391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:15.174829 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:15.175513 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:15.176050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:15.176504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:15.313552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:15.322398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:15.323684 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:15.324873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c5326065-85be-47a0-9077-bfa699e0914d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.162141 Sep 15 12:26:15.325437 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 94/204] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:15 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:15.429911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:15.430448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:15.436954 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:15.437431 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:15.437857 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:15.438528 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:15.438973 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:15.439392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:15.571993 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:15.581671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-187258e7-06be-4d9e-ab6e-24a37af0e885 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.155552 Sep 15 12:26:15.582331 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 111/205] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:15 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:16.151322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:16.151959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:16.158574 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:16.159046 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:16.159475 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:16.160149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:16.160595 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:16.161039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:16.349540 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:16.350092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:16.357053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:16.357530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:16.357970 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:16.358653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:16.359097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:16.360662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:16.472261 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:16.481496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8426cbf2-5c2a-4216-9c05-014303a66637 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.333907 Sep 15 12:26:16.482082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 95/206] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:16 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:16.515967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:16.523855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:16.525537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:16.526687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f8e231bd-dae4-4d7e-98ac-bcaf0b6f3495 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.181097 Sep 15 12:26:16.527256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 112/207] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:16 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:16.605706 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:16.606287 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:16.612297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:16.612808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:16.613277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:16.613963 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:16.614416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:16.614865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:16.619600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:16.743956 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:16.751579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c8b5d6ae-3e9c-48da-bff9-418d859984eb tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.150141 Sep 15 12:26:16.752140 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 96/208] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:16 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:17.504896 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:17.505506 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:17.515204 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:17.515690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:17.516130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:17.516839 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:17.517291 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:17.517711 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:17.551635 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:17.552343 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:17.559676 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:17.560456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:17.561106 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:17.561806 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:17.562262 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:17.562680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:17.714061 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:17.722768 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2579682c-e601-466d-9f29-e7a2ded4a707 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.221784 Sep 15 12:26:17.723428 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 113/209] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:17 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:17.744487 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:17.752647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:17.754154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:17.755339 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-48ef81cd-743d-45aa-a4e1-52721f9007a0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.207511 Sep 15 12:26:17.755901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 97/210] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:17 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:17.774299 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:17.774937 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:17.780721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:17.781246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:17.781688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:17.782371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:17.782820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:17.783243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:18.046478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:18.054080 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b6a5e026-228e-46fc-9f0a-a1ce223c6367 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.283619 Sep 15 12:26:18.054647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 114/211] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:17 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:18.746994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:18.747610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:18.754568 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:18.755046 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:18.755480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:18.756302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:18.756709 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:18.757160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:18.782384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:18.783084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:18.789697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:18.790163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:18.791740 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:18.792473 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:18.792954 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:18.793379 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:18.942427 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:18.950739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-51d54b27-2bf0-4bad-8281-b12d0934ce40 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.208112 Sep 15 12:26:18.951309 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 98/212] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:18 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:18.970541 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:18.980073 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:18.981581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:18.982814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e3dc0a4b-d024-44ae-925b-3702b96669e6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.204303 Sep 15 12:26:18.983333 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 115/213] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:18 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:19.076969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:19.077583 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:19.083541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:19.084026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:19.084460 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:19.085171 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:19.085629 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:19.086052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:19.232489 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:19.240201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4ea044ab-9406-48ef-8a8a-74f9d2342f35 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.167235 Sep 15 12:26:19.240952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 99/214] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:19 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:19.975255 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:19.975869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:19.983009 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:19.983489 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:19.984120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:19.984838 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:19.985291 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:19.985710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:20.010172 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:20.010793 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:20.017555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:20.018111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:20.018465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:20.019147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:20.019592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:20.020313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:20.174607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:20.183444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a60a9c94-e04c-4f0f-9ab4-6cd066e2a2e8 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.211985 Sep 15 12:26:20.184012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 116/215] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:19 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:20.196533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:20.204649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:20.206135 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:20.207297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-86c49b6c-316a-488a-b03b-61396a1ee2a7 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.201826 Sep 15 12:26:20.207864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 100/216] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:20 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:20.263355 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:20.263963 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:20.269917 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:20.270395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:20.270824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:20.271502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:20.271946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:20.272359 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:20.289753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:20.410020 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:20.418710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-073fa33f-8722-4124-86e7-ea352f642342 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.159301 Sep 15 12:26:20.419509 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 117/217] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:20 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:20.971871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4a88dde0-edb2-4d7d-947b-19ccedde5855 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: .version_select at 0x7ff0d077e0d0>, body: {"keypair": {"name": "tempest-keypair-664815412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAplszOGaY7Ao2eFhUYumRuEE1MhvqiH9FdCrdhvrB4WxFFw5iCrl6TvVkjKPwR+8Jc2fJ3mYgg410j5mH9SBIo/6+hPIz7ePMrZ6iz+eG/P5aQQnGA2IOP9J+ZfTKv8bg=="}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:20.987708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-4a88dde0-edb2-4d7d-947b-19ccedde5855 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:26:20.991638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-4a88dde0-edb2-4d7d-947b-19ccedde5855 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:26:21.013331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4a88dde0-edb2-4d7d-947b-19ccedde5855 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045540 Sep 15 12:26:21.013933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 101/218] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:26:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:26:21.205669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:21.206311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:21.212707 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:21.213742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:21.214177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:21.214865 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:21.215315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:21.215741 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:21.234372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:21.235254 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:21.243376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:21.244109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:21.244578 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:21.245333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:21.245790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:21.246276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:21.425342 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:21.435215 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e9d1a256-2be1-47ee-9d31-c01b69005b91 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.233131 Sep 15 12:26:21.435960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 118/219] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:21 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:21.449111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:21.456938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:21.458242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:21.458511 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:21.458898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:21.460012 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f2e72f38-9365-47bf-acbd-1d307fc52cf0 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.231226 Sep 15 12:26:21.472780 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 102/220] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:21 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:21.473086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:21.473086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:21.473086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:21.473086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:21.473420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:21.473420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:21.632965 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:21.641389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1c72cb91-deda-438e-88ae-e2935976c366 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.191071 Sep 15 12:26:21.642273 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 119/221] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:21 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:22.302611 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1407800129", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1f39d5a-ab5e-4464-9fc6-537bb91606a6"}], "security_groups": [{"name": "tempest-securitygroup--1819557883"}], "key_name": "tempest-keypair-664815412", "user_data": "}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:22.406815 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] validate_networks() for [('c1f39d5a-ab5e-4464-9fc6-537bb91606a6', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:26:22.459399 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:22.459943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:22.466367 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.466851 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.467287 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.467970 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.468679 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.469134 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.691352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:22.699614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cb91ef19-5613-4ab2-ace1-ade1bbecc09c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.244190 Sep 15 12:26:22.700182 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 120/222] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:22 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:22.722439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:22.723041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:22.729536 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.730018 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.730455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.731130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.731573 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.732184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.922605 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:26:22.923189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:26:22.923652 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:26:22.924138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:26:22.924622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:26:22.935075 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.935556 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.935990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.937144 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.937607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.938033 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.938399 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:22.949055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:22.950889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:22.952416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3e95cb70-cdaa-40bb-8682-c8e13cf9411b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1745 microversion: 2.20 time: 0.234887 Sep 15 12:26:22.953216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 121/223] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:22 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1745 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:22.958391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:26:22.960305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:22.961036 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:22.963641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:26:22.968000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.968988 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.969424 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.970268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:22.970772 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:22.971151 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:22.985372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:26:22.987705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:26:23.043160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b23767bf-b407-45b8-90fb-56e082ad6d75 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.744841 Sep 15 12:26:23.051010 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 103/224] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:26:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:26:23.061113 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6da2ed4c-b82c-41bb-8b2d-e607adba645e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:23.062638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6da2ed4c-b82c-41bb-8b2d-e607adba645e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:23.128496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6da2ed4c-b82c-41bb-8b2d-e607adba645e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:23.138865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6da2ed4c-b82c-41bb-8b2d-e607adba645e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1241 microversion: 2.1 time: 0.086370 Sep 15 12:26:23.139461 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 104/225] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:23 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:23.160036 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:23.168945 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5c249ba9-2a4f-4051-8030-e493267a6430 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.213350 Sep 15 12:26:23.181318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 122/226] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:22 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:23.724014 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:23.724980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:23.733096 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:23.733686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:23.734217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:23.734994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:23.735508 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:23.736160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:23.873289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:23.882061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-040c9462-beeb-41ce-aa5d-b30f83a6ea33 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.162279 Sep 15 12:26:23.882790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 105/227] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:23 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:23.978911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:23.979529 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:23.985669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:23.986150 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:23.986581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:23.987264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:23.987720 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:23.988140 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:24.119318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:24.132433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:24.134067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:24.136132 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6720ae81-c823-4359-80dc-60f1dd9d8ac6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1745 microversion: 2.20 time: 0.161237 Sep 15 12:26:24.136701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 123/228] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:23 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:24.163397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:24.164046 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:24.170102 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:24.170587 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:24.171028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:24.171713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:24.172168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:24.172590 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:24.193394 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:24.194074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:24.200870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:24.201589 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:24.202198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:24.203061 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:24.203725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:24.204311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:24.251295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:24.263268 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6269b38d-fff7-4e11-b5da-0d7a93d5e02a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1293 microversion: 2.1 time: 0.103175 Sep 15 12:26:24.272486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 106/229] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:24 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:24.357492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:24.365617 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-252362d4-6593-4362-86a7-f14b565bbf41 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.175905 Sep 15 12:26:24.366206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 124/230] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:24 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:24.906694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:24.907515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:24.914668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:24.915329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:24.915865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:24.917340 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:24.917875 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:24.918405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.073002 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:25.082833 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4c94f3cc-135a-4ea1-94fc-9545d2ffd5ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.180521 Sep 15 12:26:25.083432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 107/231] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:24 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:25.162680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:25.163318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:25.178700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:25.179189 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:25.179807 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.180516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:25.180997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:25.181423 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.285915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:25.286795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:25.293889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:25.294609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:25.295199 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.295890 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:25.296330 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:25.297015 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.334015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:25.344978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:25.346654 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:25.348209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3d0e2f83-338f-483f-a38b-3690a61abff9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1745 microversion: 2.20 time: 0.189666 Sep 15 12:26:25.368882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 125/232] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:25 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:25.376846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:25.384411 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d10886f0-091d-4f54-b9be-83d375834dc6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1299 microversion: 2.1 time: 0.102297 Sep 15 12:26:25.385601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 108/233] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:25 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:25.399956 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:25.401888 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:25.408619 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:25.409142 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:25.409576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.410269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:25.410704 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:25.411121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:25.563392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:25.572106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-dadb1be5-8bf7-4593-90cb-191dd0b5a575 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.181657 Sep 15 12:26:25.573439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 126/234] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:25 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:26.107260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:26.108301 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:26.116738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.118302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.118777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.122630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.123318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.123918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.250824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-009b496a-98d3-47ec-bc48-32fab401fd0a req-0a1726ba-857c-4464-b491-3426b4042f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a55838-1ab5-494c-89fb-1781130c69c6", "tag": "99b4daad-7d0f-4c0a-9a79-cedda5273d21"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:26.276567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-009b496a-98d3-47ec-bc48-32fab401fd0a req-0a1726ba-857c-4464-b491-3426b4042f4a service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.280703 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-009b496a-98d3-47ec-bc48-32fab401fd0a req-0a1726ba-857c-4464-b491-3426b4042f4a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.282788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-009b496a-98d3-47ec-bc48-32fab401fd0a req-0a1726ba-857c-4464-b491-3426b4042f4a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.328023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-009b496a-98d3-47ec-bc48-32fab401fd0a req-0a1726ba-857c-4464-b491-3426b4042f4a service nova] Creating event network-changed:99b4daad-7d0f-4c0a-9a79-cedda5273d21 for instance 25a55838-1ab5-494c-89fb-1781130c69c6 on hv-cinder-85083 Sep 15 12:26:26.336042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-009b496a-98d3-47ec-bc48-32fab401fd0a req-0a1726ba-857c-4464-b491-3426b4042f4a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090417 Sep 15 12:26:26.338652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 127/235] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:26:26.380507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:26.381262 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:26.395900 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:26.402995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.406645 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.407133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.407894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.408363 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.408819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.409343 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ae4c7b29-2d36-459e-a796-b6677f03a684 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.306920 Sep 15 12:26:26.411068 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 109/236] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:26 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:26.423880 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:26.424180 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:26.442706 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.444574 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.446612 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.450187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.450895 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.451519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.679109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:26.692353 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2a11d7f2-aa35-4de5-abc4-b35289a80ff9 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.280169 Sep 15 12:26:26.696695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 110/237] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:26 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:26.698641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:26.703857 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:26.704608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:26.719329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:26.723753 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.724486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.724879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:26.726418 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6c91646c-a9de-4b5b-a4e9-c1afbc3ab4e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.352763 Sep 15 12:26:26.726541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.740789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:26.740789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:26.740789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:26.741535 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 128/238] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:26 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:26.915414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:26.924812 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2803a466-bf39-4a82-b459-ed9f9248c475 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.225402 Sep 15 12:26:26.925671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 111/239] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:26 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:27.094106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-dc30ba8a-1c9c-422c-a65b-341a98665472 req-932e7660-f9eb-47a6-ac14-00297fb5dd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "name": "network-vif-plugged", "status": "completed", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:27.108032 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-dc30ba8a-1c9c-422c-a65b-341a98665472 req-932e7660-f9eb-47a6-ac14-00297fb5dd3f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.109239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-dc30ba8a-1c9c-422c-a65b-341a98665472 req-932e7660-f9eb-47a6-ac14-00297fb5dd3f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.109895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-dc30ba8a-1c9c-422c-a65b-341a98665472 req-932e7660-f9eb-47a6-ac14-00297fb5dd3f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:27.126099 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-dc30ba8a-1c9c-422c-a65b-341a98665472 req-932e7660-f9eb-47a6-ac14-00297fb5dd3f service nova] Creating event network-vif-plugged:d1879643-5968-44a1-9897-dfed95801b5f for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 on hv-cinder-85083 Sep 15 12:26:27.131848 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-dc30ba8a-1c9c-422c-a65b-341a98665472 req-932e7660-f9eb-47a6-ac14-00297fb5dd3f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042564 Sep 15 12:26:27.132466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 129/240] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:26:27.442043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:27.445241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:27.452983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.452983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.453295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:27.453705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.454370 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.454807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:27.628670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:27.642779 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-747faf3e-7de3-4083-9e35-0c1d8df82067 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1724 microversion: 2.1 time: 0.204490 Sep 15 12:26:27.643991 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 112/241] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:27 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:27.724705 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:27.725512 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:27.734489 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.734977 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.735408 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:27.736104 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.736554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.736999 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:27.754721 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:27.755658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:27.767654 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.768372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.769134 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:27.770573 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:27.771705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:27.772421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:28.045325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:28.048493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:28.053971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:28.055426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:28.056873 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-571d518b-954e-44cd-a074-d92065c95fff tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.339175 Sep 15 12:26:28.057194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-22085f2c-1fce-4376-ac06-252fef2cea58 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.305743 Sep 15 12:26:28.057485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 130/242] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:27 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:28.075548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:28.075865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 113/243] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:27 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:28.076163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:28.082297 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:28.082774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:28.083209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:28.083896 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:28.084343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:28.084794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:28.279051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:28.290365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5fececd5-572f-4473-982d-7e04cf14b3c6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.219926 Sep 15 12:26:28.291989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 131/244] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:28 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:28.667814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:28.668736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:28.675808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:28.676496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:28.677060 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:28.677994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:28.679195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:28.680103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:28.843193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:28.851922 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5b9f7ba6-8f27-466d-b3bc-ee2558ef2331 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1701 microversion: 2.1 time: 0.188197 Sep 15 12:26:28.870875 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 114/245] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:28 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1701 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:28.876962 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ce2e4704-2118-4edc-a8d7-e68eb6428473 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:28.885525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ce2e4704-2118-4edc-a8d7-e68eb6428473 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:28.886238 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ce2e4704-2118-4edc-a8d7-e68eb6428473 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:28.886830 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ce2e4704-2118-4edc-a8d7-e68eb6428473 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:28.959294 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ce2e4704-2118-4edc-a8d7-e68eb6428473 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Going to try to start instance {{(pid=120437) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 12:26:29.037119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ce2e4704-2118-4edc-a8d7-e68eb6428473 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action" status: 202 len: 0 microversion: 2.1 time: 0.163659 Sep 15 12:26:29.042398 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 132/246] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:26:28 2022] POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:26:29.050483 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:29.051090 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:29.058530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.059014 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.059579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.060336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.060810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.061207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.080256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:29.081267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:29.095622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.096116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.096547 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.097271 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.104047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.104729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.117433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=100 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:29.514853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:29.518688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:29.535224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-778510f5-94d1-4654-a702-7cd2991e0a4a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1710 microversion: 2.1 time: 0.488108 Sep 15 12:26:29.536070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 115/247] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:29 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1710 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:29.553042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1823a9ac-a9db-49ba-95f2-bbbe637be7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.467144 Sep 15 12:26:29.553042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 133/248] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:29 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:29.553042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:29.553042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:29.555969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.556554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.557222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.557947 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.558404 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.559044 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.561747 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:29.562623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:29.578088 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.586751 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.586964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:29.588291 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.589269 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:29.589924 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:29.590351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:29.783635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:29.798068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:29.802003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:29.806313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-97eb8f1b-1922-42f9-a22f-23e3b00249dd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.261476 Sep 15 12:26:29.807373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 134/249] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:29 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:29.835055 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:29.850292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6814ac7e-5ac8-4151-beae-d44cc6e25dad tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.294010 Sep 15 12:26:29.851226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 116/250] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:29 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:30.561020 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:30.561728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:30.576022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.576610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.580173 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.581204 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.581743 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.582239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.592666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:30.593930 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:30.605698 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.606474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.611924 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.612950 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.613623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.614518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.851867 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:30.861348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-14bd6f69-17a9-4c34-8209-9e12483ec75c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1710 microversion: 2.1 time: 0.304751 Sep 15 12:26:30.861941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 135/251] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:30 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1710 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:30.871212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:30.871759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:30.885680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.886178 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.886616 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.887467 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.888012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.888445 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.926065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:30.935231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-34bebcee-1794-4b9f-a60e-ac009a530556 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.347138 Sep 15 12:26:30.935839 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 117/252] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:30 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:30.952598 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:30.953249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:30.975467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.975467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.975467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:30.975467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:30.975926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:30.975926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:31.171780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:31.191026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:31.192537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:31.197592 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d9ad3c3c-7e30-4bf3-9380-734d8f8c1f2f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.334070 Sep 15 12:26:31.198183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 136/253] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:30 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:31.273368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:31.295861 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b68c0119-0c3f-4b6d-a9a7-210be1d2e1b2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.354064 Sep 15 12:26:31.295861 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 118/254] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:30 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:31.896446 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:31.897048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:31.905257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:31.906382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:31.907194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:31.908062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:31.908665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:31.909416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:31.966298 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:31.966910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:31.984078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:31.984589 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:31.985062 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:31.985777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:31.986231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:31.986655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:32.461754 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:32.473127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-270220a9-d9d2-4344-9938-1c8785e9551f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.510844 Sep 15 12:26:32.475202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 119/255] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:31 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:32.483756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:32.484568 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:32.497787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:32.501383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:32.502260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:32.503004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:32.503635 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:32.504270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:32.537128 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:32.549699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-85976580-8041-4548-ba80-81f3ff95393f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1714 microversion: 2.1 time: 0.658539 Sep 15 12:26:32.552970 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 137/256] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:31 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1714 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:32.559086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:32.559685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:32.566653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:32.567288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:32.567928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:32.568876 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:32.569478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:32.570050 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:32.945276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:33.000273 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:33.013276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:33.014770 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:33.018634 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-292695b7-140e-4986-b659-6c8890dec96d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.542229 Sep 15 12:26:33.019219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 120/257] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:32 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:33.048716 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:33.073047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2ddae025-ca1a-49f0-bf17-68fcc4bc3f73 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.517510 Sep 15 12:26:33.074639 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 138/258] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:32 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:33.129086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-0b7e2a0b-f989-4b51-8676-82ee977903fd req-6ddfe1b4-ad16-4f79-9736-e9200cc2e478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a55838-1ab5-494c-89fb-1781130c69c6", "name": "network-vif-plugged", "status": "completed", "tag": "99b4daad-7d0f-4c0a-9a79-cedda5273d21"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:33.140967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=12 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:33.150245 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0b7e2a0b-f989-4b51-8676-82ee977903fd req-6ddfe1b4-ad16-4f79-9736-e9200cc2e478 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:33.151078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0b7e2a0b-f989-4b51-8676-82ee977903fd req-6ddfe1b4-ad16-4f79-9736-e9200cc2e478 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:33.151681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0b7e2a0b-f989-4b51-8676-82ee977903fd req-6ddfe1b4-ad16-4f79-9736-e9200cc2e478 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:33.164984 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-0b7e2a0b-f989-4b51-8676-82ee977903fd req-6ddfe1b4-ad16-4f79-9736-e9200cc2e478 service nova] Creating event network-vif-plugged:99b4daad-7d0f-4c0a-9a79-cedda5273d21 for instance 25a55838-1ab5-494c-89fb-1781130c69c6 on hv-cinder-85083 Sep 15 12:26:33.171831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-0b7e2a0b-f989-4b51-8676-82ee977903fd req-6ddfe1b4-ad16-4f79-9736-e9200cc2e478 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046348 Sep 15 12:26:33.173004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 121/259] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:26:33.505606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:33.506557 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:33.516305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:33.517097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:33.517715 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:33.518592 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:33.519201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:33.519885 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:33.712185 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:33.721252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2832a15b-be1b-47f0-9652-815eb496fd5f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.219247 Sep 15 12:26:33.722653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 139/260] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:33 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:34.045417 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:34.046754 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:34.053219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:34.053707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:34.054151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:34.054848 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:34.055304 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:34.055744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:34.096040 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:34.096835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:34.106724 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:34.107513 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:34.108128 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:34.109054 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:34.109664 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:34.110245 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:34.267978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:34.282421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:34.284092 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:34.285317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-84df5472-9307-46d3-82c6-c29e28b9e52e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.244773 Sep 15 12:26:34.296610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 122/261] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:34 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:34.309607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:34.317742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-40d05ca9-8c23-4b09-9252-c7fe3f867f07 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.226112 Sep 15 12:26:34.318326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 140/262] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:34 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:34.747392 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:34.748375 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:34.755157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:34.755717 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:34.756415 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:34.757591 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:34.758260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:34.758853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:34.923130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:34.934982 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fbe111b5-b5b7-484a-a085-6ed030fa4e71 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1367 microversion: 2.1 time: 0.191895 Sep 15 12:26:34.936786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 123/263] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:34 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:35.311994 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:35.313389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:35.323516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:35.324623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:35.325329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:35.326218 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:35.327578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:35.328170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:35.344182 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:35.346519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:35.357141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:35.357606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:35.358002 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:35.358732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:35.359169 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:35.359596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:35.620554 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:35.629621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b5b9f2f1-ba5d-4cee-8336-0ab3ad135887 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1522 microversion: 2.1 time: 0.290810 Sep 15 12:26:35.630469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 124/264] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:35 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:35.648972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:35.661189 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:35.666699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:35.668119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8ff539eb-49dd-43e3-87e1-7c66ca2429a1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.360601 Sep 15 12:26:35.670584 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 141/265] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:35 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:35.962673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:35.963289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:35.970497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:35.971379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:35.971979 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:35.972896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:35.973496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:35.974256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:36.174536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:36.183675 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-10a358f1-b85c-4ad6-8abc-41efcda2a0d4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1557 microversion: 2.1 time: 0.225814 Sep 15 12:26:36.184488 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 125/266] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:35 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:36.206367 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:36.207136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:36.213994 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:36.214482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:36.214912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:36.215786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:36.216236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:36.216656 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:36.360243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-53a6c526-0247-4a9a-b211-981d3ea655b2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157573 Sep 15 12:26:36.368317 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 142/267] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:26:36 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:26:36.653521 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:36.654956 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:36.662744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:36.663752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:36.664404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:36.666024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:36.666625 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:36.667378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:36.695601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:36.696468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:36.706900 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:36.707901 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:36.709873 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:36.711688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:36.712971 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:36.713575 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:37.025732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:37.031338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:37.035081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a3ba04f3-2659-431d-bdf7-14cf718d4f70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1502 microversion: 2.1 time: 0.385657 Sep 15 12:26:37.041923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:37.042615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 126/268] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:36 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:37.043729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:37.045372 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2f48f48f-600d-4fbf-9639-a9238253616c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1740 microversion: 2.20 time: 0.353478 Sep 15 12:26:37.045933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 143/269] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:36 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:37.064800 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:37.064800 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:37.066592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:37.067087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:37.067527 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:37.068223 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:37.068680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:37.069132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:37.320371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:37.328823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b32c00a7-4f47-4208-b126-7e5dce4763e8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1515 microversion: 2.1 time: 0.273933 Sep 15 12:26:37.329500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 127/270] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:37 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:37.599237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-ccf2877d-b325-48e1-b083-301a4aadc4d5 req-4bfe18e4-9172-4835-b44b-8a8fad48af02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a55838-1ab5-494c-89fb-1781130c69c6", "tag": "99b4daad-7d0f-4c0a-9a79-cedda5273d21"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:37.611421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-ccf2877d-b325-48e1-b083-301a4aadc4d5 req-4bfe18e4-9172-4835-b44b-8a8fad48af02 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:37.612111 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-ccf2877d-b325-48e1-b083-301a4aadc4d5 req-4bfe18e4-9172-4835-b44b-8a8fad48af02 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:37.612537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-ccf2877d-b325-48e1-b083-301a4aadc4d5 req-4bfe18e4-9172-4835-b44b-8a8fad48af02 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:37.631790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-ccf2877d-b325-48e1-b083-301a4aadc4d5 req-4bfe18e4-9172-4835-b44b-8a8fad48af02 service nova] Creating event network-changed:99b4daad-7d0f-4c0a-9a79-cedda5273d21 for instance 25a55838-1ab5-494c-89fb-1781130c69c6 on hv-cinder-85083 Sep 15 12:26:37.638443 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-ccf2877d-b325-48e1-b083-301a4aadc4d5 req-4bfe18e4-9172-4835-b44b-8a8fad48af02 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042895 Sep 15 12:26:37.639626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 144/271] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:26:38.072091 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:38.072945 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:38.079193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:38.081347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:38.081913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:38.082801 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:38.083707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:38.084296 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:38.084862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:38.240705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:38.250659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:38.252357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:38.253642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7d341785-85c8-4368-b0a8-9a6bfe1a8a67 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1722 microversion: 2.20 time: 0.185915 Sep 15 12:26:38.254797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 128/272] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:38 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:38.759044 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:38.761413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:38.763597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=82 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:38.769015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:38.769579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:38.770084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:38.770862 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:38.771397 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:38.771927 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:38.795594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'flavor' on Instance uuid 549690bd-637f-4b47-a149-1ccc7f45ec42 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:26:38.867635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9a7c5b6c-b9de-4d5e-9e64-65834628e7e1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/action" status: 200 len: 32 microversion: 2.1 time: 0.113654 Sep 15 12:26:38.872785 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 145/273] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:26:38 2022] POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:26:38.877579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:38.878182 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:38.884719 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:38.885234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:38.885661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:38.886336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:38.886781 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:38.887197 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:39.014919 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:39.022539 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-330bba5e-f480-406f-b0e7-9a98176bb594 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.148717 Sep 15 12:26:39.023112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 129/274] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:38 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:39.283727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:39.284370 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:39.290643 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:39.291116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:39.291546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:39.292227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:39.292669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:39.293113 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:39.422872 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:39.431507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:39.432972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:39.434131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b6a8cc62-a5cc-45c7-9ecc-f70d5bd4902f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1722 microversion: 2.20 time: 0.154816 Sep 15 12:26:39.434714 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 146/275] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:39 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:40.047333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:40.047970 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:40.054488 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:40.054968 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:40.055405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:40.056094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:40.056548 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:40.057039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:40.193854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:40.203575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2b09b786-fbfb-4177-b36c-719c0d85db67 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.159277 Sep 15 12:26:40.204519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 130/276] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:40 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:40.460042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:40.460736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:40.467619 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:40.468377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:40.468842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:40.469567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:40.470021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:40.470450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:40.595332 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:40.603795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:40.605284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:40.606452 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4092f39e-dd83-4a87-86a7-35af7983c060 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1725 microversion: 2.20 time: 0.150929 Sep 15 12:26:40.607310 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 147/277] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:40 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:40.631415 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f27d6de4-0325-439d-8d54-6a958ae82f43"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:40.634383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:40.640269 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:40.640746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:40.641211 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:40.641900 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:40.642355 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:40.642782 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:40.831792 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:40.940407 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-343c7bf4-002d-4469-aeaf-20dac2ada40b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312904 Sep 15 12:26:40.941129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 131/278] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Sep 15 12:26:40 2022] POST /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:26:41.008326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-5a4e51be-5384-40da-ac9c-e479593a857d req-a57e1c79-45f2-4b7d-bc1f-6039a435af2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "name": "network-vif-unplugged", "status": "completed", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:41.018688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5a4e51be-5384-40da-ac9c-e479593a857d req-a57e1c79-45f2-4b7d-bc1f-6039a435af2c service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.019168 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5a4e51be-5384-40da-ac9c-e479593a857d req-a57e1c79-45f2-4b7d-bc1f-6039a435af2c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.019601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5a4e51be-5384-40da-ac9c-e479593a857d req-a57e1c79-45f2-4b7d-bc1f-6039a435af2c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.030804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.compute.server_external_events [req-5a4e51be-5384-40da-ac9c-e479593a857d req-a57e1c79-45f2-4b7d-bc1f-6039a435af2c service nova] Unable to find a host for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590. Dropping event network-vif-unplugged {{(pid=120437) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 12:26:41.031725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-5a4e51be-5384-40da-ac9c-e479593a857d req-a57e1c79-45f2-4b7d-bc1f-6039a435af2c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027251 Sep 15 12:26:41.032640 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 148/279] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 15 12:26:41.078493 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:41.079091 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:41.086134 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.086620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.087086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.087771 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.088220 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.088644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.130838 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120436) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 12:26:41.196890 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-41a4cdc2-77e2-4055-923b-25479592cac3 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/action" status: 202 len: 0 microversion: 2.20 time: 0.122240 Sep 15 12:26:41.197817 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 132/280] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 12:26:41 2022] POST /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:26:41.205707 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:41.206448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:41.212446 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.213235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.213675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.214366 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.214821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.215250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.228524 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:41.229467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:41.237148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.237738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.238368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.239163 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:41.239841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:41.240349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:41.423138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:41.432498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:41.434197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:41.436615 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ef1e0d30-6c3c-4e08-a1c8-b7c98210b18b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1751 microversion: 2.20 time: 0.234638 Sep 15 12:26:41.437480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 149/281] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:41 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:41.437728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:41.446471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b00a0872-10fe-44b8-a67f-07631ca5a71d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.222860 Sep 15 12:26:41.452830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 133/282] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:41 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:42.463381 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:42.463925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:42.469292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:42.470404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:42.470768 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:42.471250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:42.471683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:42.472390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:42.472861 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:42.473311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:42.476835 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:42.477289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:42.478277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:42.478983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:42.479431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:42.479858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:42.667524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:42.671294 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:42.671912 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:42.677505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:42.678991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:42.679696 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-81bab5d1-c8ad-4d1e-abe5-c4cac4b0380c tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.214405 Sep 15 12:26:42.680100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7dfa8a9e-793e-49cc-b103-a41be827fed4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1753 microversion: 2.20 time: 0.221180 Sep 15 12:26:42.680653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 150/284] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:42 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:42.680818 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 134/284] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:42 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:26:43.703958 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:43.704565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:43.712898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:43.713389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:43.713835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:43.714098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:43.714578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:43.714960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:43.715331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:43.715441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:43.722120 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:43.722586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:43.723016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:43.723706 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:43.724150 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:43.724567 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:43.914353 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:43.917764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:43.923435 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:43.925087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:43.925752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6566036b-c567-427d-86a4-ba6fc989b10f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.226249 Sep 15 12:26:43.926335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 151/285] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:43 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:43.926788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8399a234-fc5d-420f-a314-529e9758d881 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.217336 Sep 15 12:26:43.927336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 135/286] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:43 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:44.950941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:44.951562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:44.958608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:44.959102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:44.959536 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:44.960429 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:44.960555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:44.961257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:44.961894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:44.962488 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:44.971727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:44.977214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:44.978578 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:44.978951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:44.979413 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:44.989464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:45.183374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:45.191861 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a5acf1f6-19d8-4482-98c6-85dc94aef0b9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.246340 Sep 15 12:26:45.192674 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 152/287] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:44 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:45.223111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:45.232883 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:45.234323 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:45.235696 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f26e82bd-3a01-455d-8020-1627a1c5a13d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.286787 Sep 15 12:26:45.236740 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 136/288] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:44 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:46.215433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:46.216147 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:46.223797 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:46.224431 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:46.224896 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:46.225596 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:46.226051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:46.226578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:46.264533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:46.265127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:46.272176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:46.272882 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:46.273318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:46.274016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:46.274498 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:46.274919 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:46.405284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:46.413068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6b07d685-c621-4d4b-9303-c5bdd8f11fd6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.201386 Sep 15 12:26:46.413653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 153/289] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:46 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:46.448247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:46.467165 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:46.468907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:46.470087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-30cf580c-ee3a-401e-9191-1d3e96ec1685 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.209887 Sep 15 12:26:46.470694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 137/290] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:46 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:47.437059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:47.437713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:47.444179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:47.444661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:47.445120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:47.446768 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:47.447454 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:47.448085 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:47.495984 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:47.497755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:47.509564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:47.513562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:47.514018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:47.514751 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:47.515205 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:47.515666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:47.633267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:47.642082 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2448b6bd-62ce-4506-a4d0-474bfd6b7d00 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.208876 Sep 15 12:26:47.642871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 154/291] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:47 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:47.683588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:47.694659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:47.696680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:47.697904 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8feae8ee-5b68-4857-bc14-c39f766e1fb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.205996 Sep 15 12:26:47.698473 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 138/292] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:47 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:48.668203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:48.668950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:48.675383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:48.676100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:48.676709 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:48.677606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:48.678212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:48.678807 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:48.724090 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:48.724985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:48.731798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:48.732280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:48.732712 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:48.733444 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:48.733899 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:48.734322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:48.901727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:48.909377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f9c9614f-647b-48ca-a565-7ac123ab249d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.245498 Sep 15 12:26:48.909948 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 155/293] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:48 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:48.917791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:48.926504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:48.927878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:48.929364 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4cdde32e-12f3-45ce-8591-148cfcbce431 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.209646 Sep 15 12:26:48.929921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 139/294] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:48 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:49.933447 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:49.934081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:49.940405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:49.940930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:49.941369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:49.942059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:49.942514 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:49.942943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:49.955299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:49.955903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:49.963724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:49.964210 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:49.964706 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:49.965554 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:49.966269 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:49.966857 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:50.147325 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:50.156227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b9ca5c5b-733c-49ab-a750-903e1ffa3670 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.226517 Sep 15 12:26:50.157570 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 156/295] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:49 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:50.172477 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:50.181984 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:50.183527 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:50.184655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7632d98d-7579-4386-a505-1a6aa9be2574 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.233184 Sep 15 12:26:50.196894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 140/296] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:49 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:51.179834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:51.181089 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:51.188773 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:51.189275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:51.189705 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:51.190384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:51.190830 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:51.191252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:51.211828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:51.212535 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:51.219732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:51.220220 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:51.220697 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:51.221662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:51.222383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:51.222992 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:51.391280 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:51.405670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b9b63e20-c879-4b64-a7da-cf16411a0402 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.229473 Sep 15 12:26:51.406142 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 157/297] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:51 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:51.408540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:51.419823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:51.422130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:51.424833 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c9851857-5075-4ada-b9c3-da907ab9c358 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.216952 Sep 15 12:26:51.426076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 141/298] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:51 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:52.435030 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:52.435659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:52.442441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:52.442918 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:52.443346 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:52.444249 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:52.444702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:52.445148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:52.460797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:52.461442 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:52.468281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:52.468779 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:52.469214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:52.472632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:52.473354 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:52.474720 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:52.854693 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:52.859162 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:52.862700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-68d19db5-1574-48a1-a57f-2578ed031d4a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.432570 Sep 15 12:26:52.863497 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 158/299] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:52 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:52.869662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:52.871087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:52.872455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e5501eed-ad0c-44f5-a0dd-3bf9fb5ef123 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.416799 Sep 15 12:26:52.888469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 142/300] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:52 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:53.895273 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:53.896365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:53.902109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:53.902587 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:53.903017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:53.903705 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:53.904165 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:53.904565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:53.906472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:53.908445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:53.922827 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:53.924032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:53.925479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:53.926993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:53.927950 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:53.929001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:54.154049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:54.158021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:54.163656 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b440a9cf-ae21-4e18-b05a-c3d2ae71911f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.278424 Sep 15 12:26:54.164996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 159/301] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:53 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:54.172318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:54.172318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:54.172630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1d5d255f-50e3-4815-bcea-439f15553b33 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.274401 Sep 15 12:26:54.177658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 143/302] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:53 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:26:55.189361 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:55.189902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:55.196620 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:55.197130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:55.197564 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:55.198246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:55.198698 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:55.198838 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:55.199252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:55.199347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:55.205695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:55.206178 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:55.206609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:55.207295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:55.207747 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:55.208171 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:55.398422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:55.403024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:55.406905 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-78cd4832-83ad-454b-9f9d-3bacb5488a7a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.221356 Sep 15 12:26:55.407488 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 160/303] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:55 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:55.411749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:55.413209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:55.414370 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7a856576-bc55-4188-ba09-988c1153546d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.219582 Sep 15 12:26:55.414922 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 144/304] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:55 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:56.430712 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:56.431466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:56.438278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:56.438884 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:56.438996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:56.439648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:56.440266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:56.441264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:56.441933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:56.442569 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:56.445831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:56.446372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:56.446824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:56.447502 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:56.447951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:56.448367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:56.631316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:56.638048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:56.638953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-99c02791-e9e9-4331-a215-47d13ac9ee9d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.213966 Sep 15 12:26:56.639533 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 161/305] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:56 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:56.641426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:56.647348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:56.649293 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:56.650448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1f4d7b5c-b07c-4462-8cd0-a23f8421618d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.216020 Sep 15 12:26:56.650998 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 145/306] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:56 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:57.662268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:57.662915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:57.669833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:57.670310 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:57.670739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:57.671439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:57.671888 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:57.672305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:57.678178 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:57.678784 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:57.686847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:57.687324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:57.687756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:57.688474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:57.688967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:57.689393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:57.864744 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:57.873108 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2ec46f82-0f56-46c1-a67f-2e62fd9da099 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.214802 Sep 15 12:26:57.873685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 162/307] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:57 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:57.875891 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:57.884885 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:57.886322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:57.887503 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-40420130-5fc3-43b8-b63d-6aadee26b95c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.213177 Sep 15 12:26:57.888229 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 146/308] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:57 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:58.895724 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:58.896366 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:58.902832 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:58.903313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:58.903746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:58.904421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:58.904894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:58.905313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:58.912510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:58.913149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:58.922640 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:58.923132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:58.923755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:58.924520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:58.924994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:58.925528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.090329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:59.098219 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ff265d32-49c5-43d9-ad72-158270ffc733 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1501 microversion: 2.1 time: 0.206404 Sep 15 12:26:59.098786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 163/309] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:58 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:26:59.111236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:59.119890 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:59.120190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61551a49-baf6-4d87-8f10-68aa728c58f8"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:59.121348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:59.122503 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-19f20988-e21b-404d-aba5-1b4d00f899e8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.213899 Sep 15 12:26:59.122659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:59.123053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 147/310] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:26:58 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:26:59.128358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:59.128868 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:59.129300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.129986 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:59.130434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:59.130858 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.154396 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] HTTP exception thrown: Cannot 'attach_volume' instance 549690bd-637f-4b47-a149-1ccc7f45ec42 while it is in vm_state rescued Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Request method failure captured: Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/os-volume_attachments HTTP/1.1 Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 74 Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxnB7wsCgruitXr_kJPgwhJtMaLy8atHs9pEDm71ipisUq8tht_i3pDfoIWi9GgGVnStKpeQ_I-l8Ny-Y1lJx_w7YV9xJZF3obfue8Dg2QT-VGJ1mko7WEr41DbLwHOuxNnP2JfLJNlddSyFX3y2XpPKwgIwHgREGbs49h_B4r2VeNM Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:26:59.155992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22801aa5908b4b098931d2588433e9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22801aa5908b4b098931d2588433e9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 20ca976222454c6c898d0e4b170b41fc Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {"volumeAttachment": {"volumeId": "61551a49-baf6-4d87-8f10-68aa728c58f8"}} Sep 15 12:26:59.157595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Cannot 'attach_volume' instance 549690bd-637f-4b47-a149-1ccc7f45ec42 while it is in vm_state rescued Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'server_id': '549690bd-637f-4b47-a149-1ccc7f45ec42', 'body': {'volumeAttachment': {'volumeId': '61551a49-baf6-4d87-8f10-68aa728c58f8'}}} Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:26:59.158683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 549690bd-637f-4b47-a149-1ccc7f45ec42 while it is in vm_state rescued Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:26:59.160186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 549690bd-637f-4b47-a149-1ccc7f45ec42 while it is in vm_state rescued Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Returning 409 to user: Cannot 'attach_volume' instance 549690bd-637f-4b47-a149-1ccc7f45ec42 while it is in vm_state rescued {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d2541ac9-c5b9-4341-b3b8-12cd91de1861 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041200 Sep 15 12:26:59.161791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 164/311] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:26:59 2022] POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 15 12:26:59.166664 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:26:59.167311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:59.173241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:59.173716 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:59.174146 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.174819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:59.175263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:59.175682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.239351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-68bb100a-2598-481c-8397-406721cc9ec0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/action" status: 202 len: 0 microversion: 2.1 time: 0.076826 Sep 15 12:26:59.240095 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 148/312] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:26:59 2022] POST /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 12:26:59.248817 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:26:59.249434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:26:59.255695 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:59.256462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:59.257217 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.257924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:26:59.258539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:26:59.259123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:26:59.388784 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:26:59.396920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a42d2f76-87c0-452a-a246-029646e10f55 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1509 microversion: 2.1 time: 0.151870 Sep 15 12:26:59.397500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 165/313] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:26:59 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:00.149026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:00.149721 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:00.155865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:00.156345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:00.156794 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:00.157476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:00.157924 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:00.158346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:00.293086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:00.301604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:00.303054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:00.304217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b2a29628-07c9-4bbc-ab45-4326f4b8c526 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.160011 Sep 15 12:27:00.304801 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 149/314] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:00 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:00.420988 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:00.421599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:00.427883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:00.428357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:00.428811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:00.429521 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:00.429969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:00.430463 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:00.558076 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:00.565670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-dbdebeaa-5432-4e0b-8f6e-f2ba5853591e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1509 microversion: 2.1 time: 0.148555 Sep 15 12:27:00.566226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 166/315] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:00 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:01.328536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:01.329152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:01.335747 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:01.336278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:01.336713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:01.337440 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:01.337895 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:01.338369 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:01.476566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:01.485642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:01.487076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:01.488237 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d7c12fba-7c85-45c0-8261-8b3b0430e2d4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.163741 Sep 15 12:27:01.488809 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 150/316] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:01 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:01.588975 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:01.589519 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:01.596684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:01.597180 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:01.597635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:01.598371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:01.598819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:01.599239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:01.726443 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:01.730596 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=100 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:01.735650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9ee3f08d-8c76-4565-be27-9313b3cf41a5 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1509 microversion: 2.1 time: 0.150704 Sep 15 12:27:01.736212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 167/317] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:01 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:02.514649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:02.515268 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:02.522149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:02.522628 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:02.523065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:02.523749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:02.524233 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:02.524670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:02.654812 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:02.663948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:02.665788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:02.667022 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-776a1405-e07c-4d15-ae40-20bae44c6851 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.156294 Sep 15 12:27:02.667668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 151/318] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:02 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:02.759059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:02.759671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:02.766859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:02.767267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:02.767694 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:02.768373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:02.768906 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:02.769331 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:02.898081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:02.905797 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-310601d3-ec09-4be5-a10c-fe7d888660a8 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1515 microversion: 2.1 time: 0.151296 Sep 15 12:27:02.906380 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 168/319] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:02 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:03.693169 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:03.693783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:03.700610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:03.701109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:03.701536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:03.702209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:03.702651 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:03.703066 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:03.833615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:03.843199 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:03.844635 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:03.845826 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-643ff3b1-a898-44ca-98f6-a9c14da57469 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.156574 Sep 15 12:27:03.846391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 152/320] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:03 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:04.252340 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0cb09053-78ae-4425-8520-26e13061e146 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'create', calling method: .version_select at 0x7ff0d063a5e0>, body: {"keypair": {"name": "tempest-keypair-1865722295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1RQjip+39Os4wGZvfa3skOVIRxtgp25EgNU2FmL8APV3rK9GmNPQiG7Oet/K3d491zJL+nVpe+3xK69oLtE2umWJXVsufg+3uaB2v9VIk4sv1BgaWj+VVwVZj7g+CNOw=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:04.268594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-0cb09053-78ae-4425-8520-26e13061e146 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for project 22801aa5908b4b098931d2588433e9db. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:27:04.272384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-0cb09053-78ae-4425-8520-26e13061e146 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for user 20ca976222454c6c898d0e4b170b41fc and project 22801aa5908b4b098931d2588433e9db. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:27:04.294761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0cb09053-78ae-4425-8520-26e13061e146 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046182 Sep 15 12:27:04.295335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 169/321] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:27:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:04.871133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:04.871714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:04.878330 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:04.878804 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:04.879227 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:04.879907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:04.880352 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:04.880789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:05.012464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:05.022575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:05.024661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:05.026153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0c546e8b-bbab-42d1-84c6-3cce5c7efd53 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.158868 Sep 15 12:27:05.027062 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 153/322] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:04 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:05.539187 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-354006394", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b134910-e426-40c5-a85a-f1e6c6e22348"}], "security_groups": [{"name": "tempest-securitygroup--1650454892"}], "key_name": "tempest-keypair-1865722295", "user_data": "}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:05.642415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] validate_networks() for [('0b134910-e426-40c5-a85a-f1e6c6e22348', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:27:06.010434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:27:06.010890 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:27:06.011368 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:27:06.011777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:27:06.012185 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:27:06.020725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:06.021226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:06.021661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:06.022376 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:06.022822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:06.023242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:06.039872 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for project 22801aa5908b4b098931d2588433e9db. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:27:06.043718 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Getting quotas for user 20ca976222454c6c898d0e4b170b41fc and project 22801aa5908b4b098931d2588433e9db. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:27:06.051311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:06.051914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:06.054776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:27:06.057129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:27:06.058360 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:06.058834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:06.059260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:06.059940 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:06.060412 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:06.060855 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:06.107812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-763a5f32-4e48-4970-8302-26348a230460 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.573260 Sep 15 12:27:06.108374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 170/323] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:27:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:27:06.119648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-586322a7-049b-498a-860b-2fbfff7a646b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:06.120258 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-586322a7-049b-498a-860b-2fbfff7a646b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:06.190909 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-586322a7-049b-498a-860b-2fbfff7a646b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:06.198446 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-586322a7-049b-498a-860b-2fbfff7a646b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1245 microversion: 2.1 time: 0.082720 Sep 15 12:27:06.199666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 171/324] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:06 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:06.218352 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:06.227519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:06.228916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:06.230121 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d9117649-af37-489c-8b0a-24393d1f2f6f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.182667 Sep 15 12:27:06.230676 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 154/325] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:06 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:27:07.201261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-bac8b488-7bf9-4f9f-a285-0a9e9711fcc6 req-e04e8a5d-2022-4532-b1d6-10f01b1e0586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "name": "network-vif-plugged", "status": "completed", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:07.215269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-bac8b488-7bf9-4f9f-a285-0a9e9711fcc6 req-e04e8a5d-2022-4532-b1d6-10f01b1e0586 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:07.215753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-bac8b488-7bf9-4f9f-a285-0a9e9711fcc6 req-e04e8a5d-2022-4532-b1d6-10f01b1e0586 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:07.216184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-bac8b488-7bf9-4f9f-a285-0a9e9711fcc6 req-e04e8a5d-2022-4532-b1d6-10f01b1e0586 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:07.222879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:07.223492 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:07.228373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-bac8b488-7bf9-4f9f-a285-0a9e9711fcc6 req-e04e8a5d-2022-4532-b1d6-10f01b1e0586 service nova] Creating event network-vif-plugged:d1879643-5968-44a1-9897-dfed95801b5f for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 on hv-cinder-85083 Sep 15 12:27:07.231245 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:07.233777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-bac8b488-7bf9-4f9f-a285-0a9e9711fcc6 req-e04e8a5d-2022-4532-b1d6-10f01b1e0586 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036765 Sep 15 12:27:07.234389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 172/326] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:07.237604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:07.240489 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:07.241286 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:07.241750 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:07.242178 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:07.273383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:07.274874 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:07.281157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:07.281668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:07.282131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:07.283048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:07.283547 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:07.283948 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:07.335121 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:07.345933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5957b12a-88c0-4b42-a102-9665691342c0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1305 microversion: 2.1 time: 0.127510 Sep 15 12:27:07.352808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 155/327] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:07 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:07.446146 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:07.454745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:07.456208 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:07.457400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7d3144b2-9c33-4ed8-b7c2-84a8f01f6346 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.202145 Sep 15 12:27:07.457964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 173/328] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:07 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:08.370623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:08.371235 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:08.373703 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:08.378863 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:08.379349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:08.379788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:08.380472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:08.380957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:08.381380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:08.483769 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:08.485024 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:08.495674 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:08.496994 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:08.497443 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:08.498165 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:08.499108 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:08.499731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:08.523109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:08.530852 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2a195745-512a-4cab-b35c-f8d352d3234e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.164630 Sep 15 12:27:08.531749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 156/329] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:08 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:08.641912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:08.652496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:08.654050 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:08.655305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d5fde68f-bf6c-470a-a6c3-ecd4b69b1d42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.175829 Sep 15 12:27:08.655877 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 174/330] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:08 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:27:08.936104 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-b2917812-7ed4-4e60-b62c-18bc658910de req-dd549697-e8d9-4408-b869-678dd335d19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9877ba-00fe-4496-89ec-e9b98befa363", "tag": "3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:08.946228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b2917812-7ed4-4e60-b62c-18bc658910de req-dd549697-e8d9-4408-b869-678dd335d19d service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:08.946795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b2917812-7ed4-4e60-b62c-18bc658910de req-dd549697-e8d9-4408-b869-678dd335d19d service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:08.947224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b2917812-7ed4-4e60-b62c-18bc658910de req-dd549697-e8d9-4408-b869-678dd335d19d service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:08.964196 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-b2917812-7ed4-4e60-b62c-18bc658910de req-dd549697-e8d9-4408-b869-678dd335d19d service nova] Creating event network-changed:3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3 for instance ec9877ba-00fe-4496-89ec-e9b98befa363 on hv-cinder-85083 Sep 15 12:27:08.969644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-b2917812-7ed4-4e60-b62c-18bc658910de req-dd549697-e8d9-4408-b869-678dd335d19d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039301 Sep 15 12:27:08.970247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 157/331] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:09.554115 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:09.554649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:09.557134 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:09.563471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:09.564068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:09.564508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:09.565223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:09.565676 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:09.566097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:09.684291 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:09.685135 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:09.691376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:09.691993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:09.692529 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:09.693331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:09.693854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:09.694125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:09.694412 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:09.702552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1db182f4-f883-47f2-b53d-8ac52b5f3b23 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.152429 Sep 15 12:27:09.703119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 175/332] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:09 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:09.840486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:09.849821 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:09.851489 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:09.852791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-778312be-c344-4954-9abc-e21ca965d504 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.173254 Sep 15 12:27:09.853352 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 158/333] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:09 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:27:10.725991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:10.726620 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:10.733296 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:10.733773 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:10.734202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:10.734870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:10.735313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:10.735730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:10.860203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:10.867759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7b56363f-797f-4ab8-afe5-898cdc4fea18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.145577 Sep 15 12:27:10.868352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 176/334] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:10 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:10.877770 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:10.878408 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:10.884858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:10.885333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:10.885768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:10.886445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:10.886894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:10.887315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:11.022030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:11.031299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:11.032739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:11.033959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-80c493d0-e346-473d-bfb9-b8fa360ebf91 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1809 microversion: 2.20 time: 0.160081 Sep 15 12:27:11.034514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 159/335] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:10 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:11.890300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:11.890809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:11.897742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:11.898211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:11.898702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:11.899405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:11.899849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:11.900266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:12.036810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:12.045045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0a783808-ec4d-4387-a777-afecdbdca846 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.158637 Sep 15 12:27:12.045624 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 177/336] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:11 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:12.061682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:12.062289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:12.068645 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:12.069161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:12.069595 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:12.070346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:12.070798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:12.071218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:12.195373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:12.203992 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:12.205541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:12.206743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-85d5700b-fee4-4ea8-8bb7-0dfe8f4fd845 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1796 microversion: 2.20 time: 0.149032 Sep 15 12:27:12.207302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 160/337] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:12 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1796 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:13.067864 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:13.068475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:13.075777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:13.076260 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:13.076698 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:13.077408 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:13.077862 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:13.078284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:13.210015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:13.218382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-be45b851-afcd-472b-bcb4-8a540e3c30a2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.154262 Sep 15 12:27:13.218966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 178/338] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:13 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:14.241296 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:14.241906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:14.248977 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:14.249455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:14.249887 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:14.250569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:14.251021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:14.251449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:14.375975 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:14.383544 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2e1a63d7-9e24-4670-9ff0-d90be168f5e2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.146102 Sep 15 12:27:14.384105 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 161/339] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:14 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:15.262327 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-720bb18e-6598-4274-87f9-658d23af07ba req-36abc0b9-979a-4090-9205-0895edc67b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9877ba-00fe-4496-89ec-e9b98befa363", "name": "network-vif-plugged", "status": "completed", "tag": "3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:15.272552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-720bb18e-6598-4274-87f9-658d23af07ba req-36abc0b9-979a-4090-9205-0895edc67b76 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:15.273075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-720bb18e-6598-4274-87f9-658d23af07ba req-36abc0b9-979a-4090-9205-0895edc67b76 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:15.274037 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-720bb18e-6598-4274-87f9-658d23af07ba req-36abc0b9-979a-4090-9205-0895edc67b76 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:15.285378 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-720bb18e-6598-4274-87f9-658d23af07ba req-36abc0b9-979a-4090-9205-0895edc67b76 service nova] Creating event network-vif-plugged:3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3 for instance ec9877ba-00fe-4496-89ec-e9b98befa363 on hv-cinder-85083 Sep 15 12:27:15.290729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-720bb18e-6598-4274-87f9-658d23af07ba req-36abc0b9-979a-4090-9205-0895edc67b76 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Sep 15 12:27:15.291344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 179/340] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:15.406124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:15.406878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:15.413256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:15.413735 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:15.414737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:15.415435 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:15.415886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:15.416308 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:15.420523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:15.545854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:15.553396 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6fc43b57-815b-4a14-9d93-141d82109a68 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.151205 Sep 15 12:27:15.553971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 162/341] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:15 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:16.573773 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:16.574583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=12 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:16.578903 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:16.579599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:16.586653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:16.587129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:16.587566 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:16.588240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:16.588683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:16.589125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:16.733180 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:16.740860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2b747d40-8f8d-4355-b75f-b25b8080c2de tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1371 microversion: 2.1 time: 0.168090 Sep 15 12:27:16.741416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 180/342] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:16 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:17.763367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:17.763978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:17.771226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:17.771703 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:17.772143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:17.773108 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:17.773553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:17.773976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:17.903697 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:17.911278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-305ef685-4cee-4a4c-ac12-da8dfbffa2c2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1565 microversion: 2.1 time: 0.151675 Sep 15 12:27:17.911841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 163/343] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:17 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:17.934416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:17.935001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:17.941338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:17.941808 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:17.942235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:17.942906 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:17.943350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:17.943764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:18.021386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-29f603ae-58c5-43ef-add9-f680ba0275ba tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091341 Sep 15 12:27:18.021983 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 181/344] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:27:17 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:19.111936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-e13a86ee-4a21-4d1d-8dcb-0e5afec11f3d req-91ae2634-cfa6-4620-9c6b-986f43b31a5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9877ba-00fe-4496-89ec-e9b98befa363", "tag": "3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:19.122313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-e13a86ee-4a21-4d1d-8dcb-0e5afec11f3d req-91ae2634-cfa6-4620-9c6b-986f43b31a5f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:19.122785 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-e13a86ee-4a21-4d1d-8dcb-0e5afec11f3d req-91ae2634-cfa6-4620-9c6b-986f43b31a5f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:19.123211 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-e13a86ee-4a21-4d1d-8dcb-0e5afec11f3d req-91ae2634-cfa6-4620-9c6b-986f43b31a5f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:19.134440 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-e13a86ee-4a21-4d1d-8dcb-0e5afec11f3d req-91ae2634-cfa6-4620-9c6b-986f43b31a5f service nova] Creating event network-changed:3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3 for instance ec9877ba-00fe-4496-89ec-e9b98befa363 on hv-cinder-85083 Sep 15 12:27:19.139469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-e13a86ee-4a21-4d1d-8dcb-0e5afec11f3d req-91ae2634-cfa6-4620-9c6b-986f43b31a5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031151 Sep 15 12:27:19.140379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 164/345] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:19.166326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:19.166852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:19.173654 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:19.174353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:19.174853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:19.175832 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:19.176350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:19.177074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:19.330302 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lazy-loading 'services' on Instance uuid 4481d43d-2a44-4a3c-b167-2b99e195a673 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:27:19.460477 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cde899a6-e8e8-44cf-9851-6e0372e6ef24 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-volume_attachments/8b992a60-f863-4207-8b6d-bd8d77eebcbf" status: 202 len: 0 microversion: 2.1 time: 0.299093 Sep 15 12:27:19.461148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 182/346] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:27:19 2022] DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-volume_attachments/8b992a60-f863-4207-8b6d-bd8d77eebcbf => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:27:20.608599 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-372eec2a-fb9d-4a8e-8eb8-fad1f19f47df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:20.614700 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-372eec2a-fb9d-4a8e-8eb8-fad1f19f47df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:20.615168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-372eec2a-fb9d-4a8e-8eb8-fad1f19f47df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:20.615594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-372eec2a-fb9d-4a8e-8eb8-fad1f19f47df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:20.640236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-372eec2a-fb9d-4a8e-8eb8-fad1f19f47df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Going to try to stop instance {{(pid=120436) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 12:27:20.679157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-372eec2a-fb9d-4a8e-8eb8-fad1f19f47df tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action" status: 202 len: 0 microversion: 2.1 time: 0.074947 Sep 15 12:27:20.680207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 165/347] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:27:20 2022] POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:27:20.689130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:20.689826 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:20.696871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:20.697360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:20.697801 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:20.698493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:20.699005 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:20.699392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:20.830094 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:20.837713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-29149d03-c17f-446d-a02c-44eac53a994c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.153194 Sep 15 12:27:20.838284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 183/348] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:20 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:21.862297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:21.863004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:21.869772 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:21.870250 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:21.870686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:21.871368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:21.871819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:21.872240 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.001127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:22.009317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-edcd4780-005a-44de-876e-cf8d320b6175 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.151718 Sep 15 12:27:22.009898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 166/349] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:21 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:22.713558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:22.714131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:22.721194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.721674 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.722106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.722794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.723246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.723675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.746565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9639547e-ac0c-4dd4-ba3a-8b1659a26ef6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.037420 Sep 15 12:27:22.747133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 184/350] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:27:22 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:22.758630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a4a078-9aff-4666-9f9f-dc208ff70521"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:22.760983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:22.766888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.767355 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.767799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.768454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.768930 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.769346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.846655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Invalid volume: volume 90a4a078-9aff-4666-9f9f-dc208ff70521 is already attached to instances: 3545e504-2e9b-41e0-903c-f58ab4aa380a Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: POST /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/os-volume_attachments HTTP/1.1 Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 74 Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:27:22.848388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {"volumeAttachment": {"volumeId": "90a4a078-9aff-4666-9f9f-dc208ff70521"}} Sep 15 12:27:22.849769 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Invalid volume: volume 90a4a078-9aff-4666-9f9f-dc208ff70521 is already attached to instances: 3545e504-2e9b-41e0-903c-f58ab4aa380a Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'server_id': '25a55838-1ab5-494c-89fb-1781130c69c6', 'body': {'volumeAttachment': {'volumeId': '90a4a078-9aff-4666-9f9f-dc208ff70521'}}} Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 90a4a078-9aff-4666-9f9f-dc208ff70521 is already attached to instances: 3545e504-2e9b-41e0-903c-f58ab4aa380a Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:27:22.850472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 90a4a078-9aff-4666-9f9f-dc208ff70521 is already attached to instances: 3545e504-2e9b-41e0-903c-f58ab4aa380a Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:22.852463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 90a4a078-9aff-4666-9f9f-dc208ff70521 is already attached to instances: 3545e504-2e9b-41e0-903c-f58ab4aa380a Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 400 to user: Invalid volume: volume 90a4a078-9aff-4666-9f9f-dc208ff70521 is already attached to instances: 3545e504-2e9b-41e0-903c-f58ab4aa380a {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3b28b7dd-492a-4fbc-ac40-3ffc2c57c99d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095309 Sep 15 12:27:22.853866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 167/351] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:27:22 2022] POST /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:27:22.859192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:22.859707 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:22.865567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.866046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.866479 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.867155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.867599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.868021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.891565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:27:22.969723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5e304d5e-51ba-4ae2-8201-dda5d9faf349 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 204 len: 0 microversion: 2.1 time: 0.114011 Sep 15 12:27:22.970416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 185/352] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:27:22 2022] DELETE /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:27:22.979262 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:22.979877 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:22.987141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.987623 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.988061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:22.988768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:22.989230 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:22.989653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:23.032861 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:23.033563 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:23.039440 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:23.039921 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:23.040354 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:23.041070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:23.041526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:23.041945 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:23.156736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:23.165041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ea606b5a-d773-4e93-bc90-ce594fb2940e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1681 microversion: 2.1 time: 0.190143 Sep 15 12:27:23.165847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 168/353] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:22 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:23.199276 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:23.202809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:23.207774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-56afa759-7416-4b6d-9431-8c3251beece1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.179089 Sep 15 12:27:23.208337 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 186/354] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:23 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:24.189311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:24.189925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:24.196506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:24.197013 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:24.197462 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:24.198124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:24.198572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:24.198993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:24.232053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:24.232675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:24.240610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:24.241125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:24.241562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:24.242259 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:24.242717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:24.243141 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:24.377572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:24.386210 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-552e35bf-e2b9-491f-ad44-b1f06ae0170d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1681 microversion: 2.1 time: 0.200692 Sep 15 12:27:24.386896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 169/355] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:24 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:24.407613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:24.415688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e30e5b3f-1b15-43c7-926e-0f382d9e3cde tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.187453 Sep 15 12:27:24.416275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 187/356] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:24 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:25.410275 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:25.411036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:25.418119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:25.418606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:25.419039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:25.419752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:25.420197 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:25.420626 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:25.438303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:25.438924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:25.445774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:25.446262 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:25.446696 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:25.447383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:25.447833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:25.448281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:25.621994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:25.630278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a23ba681-92cf-4696-b63c-5cababfcd899 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 200 len: 1681 microversion: 2.1 time: 0.223890 Sep 15 12:27:25.630856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 170/357] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:25 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:25.645229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:25.647238 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-77b5e5af-ed97-42ef-97cb-cf965715ff20 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.211427 Sep 15 12:27:25.647238 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 188/358] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:25 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:25.811828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-ff6e1ad9-7b81-44a2-9769-73cd1f3181a8 req-7b578b8f-2b70-4536-b279-6b246761647e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a55838-1ab5-494c-89fb-1781130c69c6", "name": "network-vif-deleted", "tag": "99b4daad-7d0f-4c0a-9a79-cedda5273d21"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:25.825073 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-ff6e1ad9-7b81-44a2-9769-73cd1f3181a8 req-7b578b8f-2b70-4536-b279-6b246761647e service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:25.826349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-ff6e1ad9-7b81-44a2-9769-73cd1f3181a8 req-7b578b8f-2b70-4536-b279-6b246761647e service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:25.827418 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-ff6e1ad9-7b81-44a2-9769-73cd1f3181a8 req-7b578b8f-2b70-4536-b279-6b246761647e service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:25.841624 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-ff6e1ad9-7b81-44a2-9769-73cd1f3181a8 req-7b578b8f-2b70-4536-b279-6b246761647e service nova] Creating event network-vif-deleted:99b4daad-7d0f-4c0a-9a79-cedda5273d21 for instance 25a55838-1ab5-494c-89fb-1781130c69c6 on hv-cinder-85083 Sep 15 12:27:25.858515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-ff6e1ad9-7b81-44a2-9769-73cd1f3181a8 req-7b578b8f-2b70-4536-b279-6b246761647e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052161 Sep 15 12:27:25.859387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 171/359] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:26.655245 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:26.655915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:26.664855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:26.664855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:26.664855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:26.665198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:26.665533 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:26.665954 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:26.670636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:26.671410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:26.685630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:26.686453 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:26.687099 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:26.688004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:26.688646 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:26.689285 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:26.704193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 HTTP/1.1 Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:27:26.707117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:27:26.708548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '25a55838-1ab5-494c-89fb-1781130c69c6'} Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:27:26.709321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:27:26.710771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:26.714940 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:27:26.716023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-234c2bb7-b197-4420-ba58-6af30a145627 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 404 len: 111 microversion: 2.1 time: 0.064807 Sep 15 12:27:26.718079 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 189/360] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:26 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:27:26.728019 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c2d179db-5f8d-472b-8361-988577ebdf8c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '.version_select at 0x7ff0d0666160>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:26.762981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c2d179db-5f8d-472b-8361-988577ebdf8c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664815412" status: 202 len: 0 microversion: 2.1 time: 0.038071 Sep 15 12:27:26.764030 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 190/361] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 12:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664815412 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:27:26.858374 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:26.868841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-453a787b-42bc-4d60-8e89-0f420e727046 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.202247 Sep 15 12:27:26.869929 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 172/362] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:26 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:27.484727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:27.485247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:27.492683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:27.493226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:27.493683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:27.494397 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:27.495224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:27.495646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:27.575926 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lazy-loading 'services' on Instance uuid 3545e504-2e9b-41e0-903c-f58ab4aa380a {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:27:27.646954 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5684f3d8-7b3d-4a23-b161-5065ed83c78b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments/90a4a078-9aff-4666-9f9f-dc208ff70521" status: 202 len: 0 microversion: 2.1 time: 0.165915 Sep 15 12:27:27.647538 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 191/363] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:27:27 2022] DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments/90a4a078-9aff-4666-9f9f-dc208ff70521 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:27:27.655982 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:27.658688 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:27.666146 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:27.666819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:27.667432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:27.668125 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:27.668579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:27.669019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:27.701073 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-335f241d-62cd-4088-aa4f-5020378f1e97 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048915 Sep 15 12:27:27.701913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 173/364] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:27:27 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:27.892636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:27.893363 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:27.900583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:27.901116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:27.901752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:27.902441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:27.902887 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:27.903299 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:28.037237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:28.045473 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f32f9160-ed2d-4734-ada0-e57c03f12fa0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.157690 Sep 15 12:27:28.046030 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 192/365] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:27 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:28.713888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:28.716069 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:28.723445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:28.723925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:28.724356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:28.725119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:28.725580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:28.725995 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:28.755036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c7ee9324-e2d1-4bee-925e-0507c87ee29d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045079 Sep 15 12:27:28.755586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 174/366] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:27:28 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:27:28.817348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:28.817851 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:28.824459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:28.824984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:28.825421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:28.826104 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:28.826557 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:28.826981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:28.850820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:27:28.926989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e12eb131-c205-4e84-841c-e991aa7c9b69 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 204 len: 0 microversion: 2.1 time: 0.113018 Sep 15 12:27:28.927873 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 193/367] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:27:28 2022] DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:27:28.936944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:28.937567 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:28.943425 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:28.943910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:28.944341 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:28.945722 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:28.946178 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:28.946601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:29.067933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:29.068646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:29.074578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:29.075064 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:29.075505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:29.075807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:29.076197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:29.076653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:29.077102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:29.083415 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6e4f9c18-828b-48a6-a789-39fa6a48813a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1679 microversion: 2.1 time: 0.150874 Sep 15 12:27:29.083976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 175/368] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:28 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:29.208387 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:29.216095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c37cd67d-c1b2-4413-bf41-b61329811b10 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.152419 Sep 15 12:27:29.216656 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 194/369] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:29 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:30.107698 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:30.108305 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:30.114742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:30.115217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:30.115909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:30.116596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:30.117647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:30.118066 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:30.239970 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:30.240504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:30.245358 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:30.247599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:30.248080 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:30.248513 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:30.249233 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:30.249682 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:30.250223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:30.256414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f1f336b2-7077-4672-a72b-8628b45e7638 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1679 microversion: 2.1 time: 0.152285 Sep 15 12:27:30.257146 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 176/370] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:30 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:30.381224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:30.388742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4871188d-e726-4646-aa88-91449fcbc56c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.152795 Sep 15 12:27:30.389315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 195/371] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:30 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:31.279692 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:31.280336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:31.286564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:31.287059 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:31.287473 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:31.288265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:31.289257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:31.289677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:31.358027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:31.365718 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4a6dc3f3-088d-4b8c-b120-75f5685a116f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 200 len: 1613 microversion: 2.1 time: 0.090078 Sep 15 12:27:31.366281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 177/372] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:31 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:31.411783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:31.412318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:31.419687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:31.420168 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:31.420603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:31.421316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:31.421766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:31.422188 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:31.563482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:31.571757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-994a8cdf-33b4-4bb8-b781-431121daa937 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.164200 Sep 15 12:27:31.572537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 196/373] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:31 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:31.583263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-d0c2f38b-09c3-43d6-a12e-c1afb6a8308b req-40b75281-aee3-433d-8688-48456a5afc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3545e504-2e9b-41e0-903c-f58ab4aa380a", "name": "network-vif-deleted", "tag": "0116ca70-581b-40a9-8ad0-31dbb2d532e7"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:31.593282 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d0c2f38b-09c3-43d6-a12e-c1afb6a8308b req-40b75281-aee3-433d-8688-48456a5afc23 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:31.593752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d0c2f38b-09c3-43d6-a12e-c1afb6a8308b req-40b75281-aee3-433d-8688-48456a5afc23 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:31.594171 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d0c2f38b-09c3-43d6-a12e-c1afb6a8308b req-40b75281-aee3-433d-8688-48456a5afc23 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:31.607830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-d0c2f38b-09c3-43d6-a12e-c1afb6a8308b req-40b75281-aee3-433d-8688-48456a5afc23 service nova] Creating event network-vif-deleted:0116ca70-581b-40a9-8ad0-31dbb2d532e7 for instance 3545e504-2e9b-41e0-903c-f58ab4aa380a on hv-cinder-85083 Sep 15 12:27:31.613074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-d0c2f38b-09c3-43d6-a12e-c1afb6a8308b req-40b75281-aee3-433d-8688-48456a5afc23 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033387 Sep 15 12:27:31.613915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 178/374] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:32.390979 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:32.391976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:32.399175 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:32.399913 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:32.400477 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:32.401519 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:32.402120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:32.402433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:32.420774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a HTTP/1.1 Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:27:32.422439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:27:32.424006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '3545e504-2e9b-41e0-903c-f58ab4aa380a'} Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:27:32.428281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:27:32.430383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:32.431655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:27:32.431655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7b776b5c-b18a-47e9-bda4-365f8fa73338 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 404 len: 111 microversion: 2.1 time: 0.036762 Sep 15 12:27:32.431655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 197/375] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:32 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:27:32.434319 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e755318d-df0e-498b-afed-5df24209ea80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '.version_select at 0x7ff0d06ba0d0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:32.456545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e755318d-df0e-498b-afed-5df24209ea80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136465553" status: 202 len: 0 microversion: 2.1 time: 0.027089 Sep 15 12:27:32.457167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 179/376] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 12:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136465553 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:27:32.601627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:32.601627 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:32.610776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:32.611277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:32.611737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:32.612418 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:32.612922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:32.613329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:32.770729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:32.782875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d808589f-3575-456f-82cd-688b9fc8ad7e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.187045 Sep 15 12:27:32.787106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 198/377] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:32 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:33.108218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-36ee5d57-ae71-4ae9-9c8d-aa84e52ba37f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: .version_select at 0x7ff0d05eaaf0>, body: {"keypair": {"name": "tempest-keypair-685330976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMwvCyySbT9FFS5SLDXWfEewY3NguAwMFfMfFO1IJ8ZrTDtpIWqa7qcS1Rvl67P6UgEKzENRcKDpNAfbd9d4GJbQPO4auAoMELtkR/m6PMVvfbh6sTIVCnQjFG9S/5mpw=="}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:33.124825 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-36ee5d57-ae71-4ae9-9c8d-aa84e52ba37f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:27:33.128941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-36ee5d57-ae71-4ae9-9c8d-aa84e52ba37f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:27:33.151538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-36ee5d57-ae71-4ae9-9c8d-aa84e52ba37f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047174 Sep 15 12:27:33.152144 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 180/378] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:27:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:33.806823 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:33.807569 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:33.814379 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:33.814855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:33.815282 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:33.815996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:33.816441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:33.816883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:34.010263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:34.018199 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-96e67599-3d74-4954-b04e-4fb74e2d968d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.215920 Sep 15 12:27:34.019076 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 199/379] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:33 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:34.496906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1038311665", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1f39d5a-ab5e-4464-9fc6-537bb91606a6"}], "security_groups": [{"name": "tempest-securitygroup--6186888"}], "key_name": "tempest-keypair-685330976", "user_data": "}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:34.600138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] validate_networks() for [('c1f39d5a-ab5e-4464-9fc6-537bb91606a6', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:27:34.970704 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:27:34.971137 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:27:34.971621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:27:34.972086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:27:34.972502 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:27:34.981431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:34.981908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:34.982371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:34.983093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:34.983545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:34.983970 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:35.000870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:27:35.004844 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:27:35.015898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:27:35.018318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:27:35.041320 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:35.041946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:35.048995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:35.049657 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:35.050241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:35.051060 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:35.051520 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:35.051946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:35.065170 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a4750076-c26c-46df-a14f-c679fe1e1afc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.573752 Sep 15 12:27:35.066195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 181/380] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:27:34 2022] POST /compute/v2.1/servers => generated 399 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:27:35.076562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-181356b8-a41d-4231-a8b7-75995d520116 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:35.077221 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-181356b8-a41d-4231-a8b7-75995d520116 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:35.154833 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-181356b8-a41d-4231-a8b7-75995d520116 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:35.162644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-181356b8-a41d-4231-a8b7-75995d520116 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1241 microversion: 2.1 time: 0.089767 Sep 15 12:27:35.164469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 182/381] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:35 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:35.217391 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:35.226351 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fab12a92-f880-441c-9f96-01cc9de0b6c5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1678 microversion: 2.1 time: 0.189095 Sep 15 12:27:35.226928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 200/382] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:35 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:36.185786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:36.186406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:36.193195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.193677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.194109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.194830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.195281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.195739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.214063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:36.248733 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:36.249561 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:36.256787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.257314 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.258037 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.259008 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.259506 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.260014 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.264467 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:36.273365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b6a94a51-f304-43e1-bfde-8e0648752fa3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1293 microversion: 2.1 time: 0.090750 Sep 15 12:27:36.274145 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 183/383] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:36 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:36.396853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:36.405658 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c6591f97-c187-4d97-9fd2-67ca2ef39dc0 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1655 microversion: 2.1 time: 0.160740 Sep 15 12:27:36.406382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 201/384] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:36 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:27:36.431133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0797178f-c0f3-4640-a069-509b253371ed tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:36.437129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0797178f-c0f3-4640-a069-509b253371ed tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.437552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0797178f-c0f3-4640-a069-509b253371ed tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.437990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0797178f-c0f3-4640-a069-509b253371ed tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.461364 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0797178f-c0f3-4640-a069-509b253371ed tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Going to try to start instance {{(pid=120436) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 12:27:36.517629 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0797178f-c0f3-4640-a069-509b253371ed tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action" status: 202 len: 0 microversion: 2.1 time: 0.090651 Sep 15 12:27:36.518658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 184/385] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:27:36 2022] POST /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:27:36.526480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:36.527405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:36.535133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.536004 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.536463 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.537195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:36.537824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:36.539363 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:36.682489 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:36.692003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-feeab0f5-b54a-4c0b-a84e-1eaadea5f092 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1664 microversion: 2.1 time: 0.169227 Sep 15 12:27:36.692524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 202/386] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:36 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:37.297414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:37.298618 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:37.305448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:37.305933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:37.306373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:37.307072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:37.307526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:37.307951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:37.445308 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:37.453118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-101a3121-608c-4e87-9613-c77679326f82 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.160367 Sep 15 12:27:37.453911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 185/387] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:37 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:37.715291 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:37.715892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:37.722762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:37.723229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:37.723687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:37.724520 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:37.724996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:37.725415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:37.747498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:37.864302 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:37.871984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-803bc021-51fa-4779-9345-df8ced120acc tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1664 microversion: 2.1 time: 0.160580 Sep 15 12:27:37.872730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 203/388] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:37 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:38.416037 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-b4edbce8-2212-4525-a80e-f57bfe430283 req-9308c501-4f5a-433a-bf50-7214d3be7971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0bbaa77-aba7-4c9b-9777-91f17808f77f", "tag": "3d96cacb-fcb2-430c-a166-5f75a66bc533"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:38.422012 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:38.430849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b4edbce8-2212-4525-a80e-f57bfe430283 req-9308c501-4f5a-433a-bf50-7214d3be7971 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:38.431331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b4edbce8-2212-4525-a80e-f57bfe430283 req-9308c501-4f5a-433a-bf50-7214d3be7971 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:38.431761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-b4edbce8-2212-4525-a80e-f57bfe430283 req-9308c501-4f5a-433a-bf50-7214d3be7971 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:38.443724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-b4edbce8-2212-4525-a80e-f57bfe430283 req-9308c501-4f5a-433a-bf50-7214d3be7971 service nova] Creating event network-changed:3d96cacb-fcb2-430c-a166-5f75a66bc533 for instance e0bbaa77-aba7-4c9b-9777-91f17808f77f on hv-cinder-85083 Sep 15 12:27:38.449125 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-b4edbce8-2212-4525-a80e-f57bfe430283 req-9308c501-4f5a-433a-bf50-7214d3be7971 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037351 Sep 15 12:27:38.449726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 186/389] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:38.475859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:38.476478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:38.486665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:38.487162 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:38.487594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:38.488453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:38.488954 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:38.489553 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:38.622940 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:38.630696 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-40c3b169-80b1-4b6f-ae0c-99f4ac4f1962 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.158720 Sep 15 12:27:38.631475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 204/390] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:38 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:38.896534 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:38.897262 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:38.903537 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:38.904013 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:38.904441 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:38.905149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:38.905599 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:38.906016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:39.037736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:39.049416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e44d81f6-e6bf-4b89-a353-980778b21a51 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1668 microversion: 2.1 time: 0.157614 Sep 15 12:27:39.049994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 187/391] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:38 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:39.654225 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:39.654834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:39.657203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:39.662805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:39.663393 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:39.663747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:39.664438 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:39.664920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:39.665345 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:39.798960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:39.806525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-10af20f6-fc13-49c8-bac4-260e3a3b6805 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.156137 Sep 15 12:27:39.807086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 205/392] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:39 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:40.829774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:40.830361 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:40.836917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:40.837394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:40.837819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:40.838491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:40.838936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:40.839351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:40.963695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:40.971612 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-60c04f3f-3665-4d5d-9a48-3216c42df979 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.145706 Sep 15 12:27:40.972185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 188/393] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:40 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:41.994282 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:41.994837 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:42.001339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:42.001814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:42.002250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:42.002934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:42.003383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:42.003804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:42.135829 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:42.145187 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-dc8ce3bb-cece-4fd9-b1c5-3b66f05139e3 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.154888 Sep 15 12:27:42.145766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 206/394] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:41 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:43.168967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:43.169512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:43.176018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:43.176495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:43.176972 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:43.177659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:43.178105 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:43.178525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:43.305573 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:43.313186 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b81a79c8-7c73-487e-b844-25cc2a5cf813 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.148145 Sep 15 12:27:43.313757 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 189/395] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:43 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:43.427662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-c4f7f9b9-4a53-44b9-b165-74ca93fecd93 req-e516ec36-ac6e-4000-9820-c0f3c54e508b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bbaa77-aba7-4c9b-9777-91f17808f77f", "name": "network-vif-plugged", "status": "completed", "tag": "3d96cacb-fcb2-430c-a166-5f75a66bc533"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:43.438292 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-c4f7f9b9-4a53-44b9-b165-74ca93fecd93 req-e516ec36-ac6e-4000-9820-c0f3c54e508b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:43.438719 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-c4f7f9b9-4a53-44b9-b165-74ca93fecd93 req-e516ec36-ac6e-4000-9820-c0f3c54e508b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:43.439139 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-c4f7f9b9-4a53-44b9-b165-74ca93fecd93 req-e516ec36-ac6e-4000-9820-c0f3c54e508b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:43.451036 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-c4f7f9b9-4a53-44b9-b165-74ca93fecd93 req-e516ec36-ac6e-4000-9820-c0f3c54e508b service nova] Creating event network-vif-plugged:3d96cacb-fcb2-430c-a166-5f75a66bc533 for instance e0bbaa77-aba7-4c9b-9777-91f17808f77f on hv-cinder-85083 Sep 15 12:27:43.455991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-c4f7f9b9-4a53-44b9-b165-74ca93fecd93 req-e516ec36-ac6e-4000-9820-c0f3c54e508b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 Sep 15 12:27:43.456772 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 207/396] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:44.338171 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:44.338716 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:44.345391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:44.345870 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:44.346301 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:44.346983 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:44.347430 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:44.347852 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:44.471783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:44.479936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ea59e34b-1d25-4eb2-aeb9-a576cedae81d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1364 microversion: 2.1 time: 0.145879 Sep 15 12:27:44.480027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 190/397] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:44 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:45.502141 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:45.502841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:45.509895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:45.510374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:45.510804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:45.511486 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:45.511936 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:45.512352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:45.641911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:45.650078 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-47e2582d-0aaa-4160-b7df-d75b57320358 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1554 microversion: 2.1 time: 0.152113 Sep 15 12:27:45.650634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 208/398] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:27:45 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:45.672888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:45.673406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:45.675288 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:45.675952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=12 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:45.682436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:45.682908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:45.683339 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:45.684022 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:45.684469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:45.684912 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:45.760209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-96433bc5-07f8-4003-9687-33982e892f3f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091107 Sep 15 12:27:45.760844 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 191/399] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:27:45 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:27:46.857623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-4b1a7dff-9c98-4d80-864e-cf8b61f5474a req-04547380-7f06-4998-9ec1-d96673ba432c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0bbaa77-aba7-4c9b-9777-91f17808f77f", "tag": "3d96cacb-fcb2-430c-a166-5f75a66bc533"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:46.867464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4b1a7dff-9c98-4d80-864e-cf8b61f5474a req-04547380-7f06-4998-9ec1-d96673ba432c service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:46.867932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4b1a7dff-9c98-4d80-864e-cf8b61f5474a req-04547380-7f06-4998-9ec1-d96673ba432c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:46.868362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4b1a7dff-9c98-4d80-864e-cf8b61f5474a req-04547380-7f06-4998-9ec1-d96673ba432c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:46.878911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-4b1a7dff-9c98-4d80-864e-cf8b61f5474a req-04547380-7f06-4998-9ec1-d96673ba432c service nova] Creating event network-changed:3d96cacb-fcb2-430c-a166-5f75a66bc533 for instance e0bbaa77-aba7-4c9b-9777-91f17808f77f on hv-cinder-85083 Sep 15 12:27:46.883629 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-4b1a7dff-9c98-4d80-864e-cf8b61f5474a req-04547380-7f06-4998-9ec1-d96673ba432c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029598 Sep 15 12:27:46.884395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 209/400] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:53.239416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:53.239968 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:53.246266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:53.246747 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:53.247176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:53.247859 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:53.248307 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:53.248728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:53.280344 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-449ebef7-23af-4d60-a561-2b25d2b13f31 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments/f27d6de4-0325-439d-8d54-6a958ae82f43" status: 200 len: 194 microversion: 2.20 time: 0.046130 Sep 15 12:27:53.280955 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 192/401] 10.222.0.15 () {60 vars in 1454 bytes} [Thu Sep 15 12:27:53 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments/f27d6de4-0325-439d-8d54-6a958ae82f43 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:27:53.349946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:53.350529 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:53.356605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:53.357116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:53.357551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:53.358234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:53.358684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:53.359190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:53.439221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lazy-loading 'services' on Instance uuid ad7e2f44-79df-47c0-b85d-68b4b96e4590 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:27:53.508623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a52c5780-5497-4388-8bf1-fee8d234a89d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments/f27d6de4-0325-439d-8d54-6a958ae82f43" status: 202 len: 0 microversion: 2.20 time: 0.163343 Sep 15 12:27:53.509276 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 210/402] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Sep 15 12:27:53 2022] DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments/f27d6de4-0325-439d-8d54-6a958ae82f43 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:27:53.518894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:53.521155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:53.527138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:53.527627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:53.528098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:53.528775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:53.529231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:53.529670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:53.559960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-58fdf8ab-2192-4686-a99e-f9e102be18d6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045690 Sep 15 12:27:53.560845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 193/403] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 12:27:53 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 12:27:54.574395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:54.576700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:54.582847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:54.583320 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:54.583753 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:54.584432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:54.584911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:54.585334 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:54.615697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a76d34a5-d6d0-4bbc-9869-cb66d8cdcde8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046640 Sep 15 12:27:54.616246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 211/404] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 12:27:54 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:27:54.681588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:54.682108 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:54.688450 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:54.688966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:54.689395 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:54.690073 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:54.690523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:54.690970 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:54.719951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Going to try to terminate instance {{(pid=120436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:27:54.800040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d3ef0f01-96e7-4359-a0af-beed12b4feb4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 204 len: 0 microversion: 2.20 time: 0.122158 Sep 15 12:27:54.800850 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 194/405] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 12:27:54 2022] DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 12:27:54.809731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:54.810335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:54.816242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:54.816715 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:54.817188 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:54.817861 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:54.818301 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:54.818716 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:54.945950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:54.954484 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:54.955922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:54.957102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-119dc11b-6a4e-4340-91a4-75cc95da838c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.151766 Sep 15 12:27:54.957659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 212/406] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:54 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:55.982497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:55.983189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:55.989772 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:55.990231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:55.990661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:55.991332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:55.991774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:55.992187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:56.122004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:56.131222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:56.132666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:56.134039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-37a0e731-6e56-45ae-ab87-5ed392cc646d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1724 microversion: 2.20 time: 0.155766 Sep 15 12:27:56.135289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 195/407] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:55 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:57.162803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:57.163426 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:57.170789 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:57.171280 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:57.171721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:57.172412 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:57.172890 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:57.173319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:57.235079 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:57.243981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:57.245484 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:27:57.246668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2e0abc93-130a-4991-a0d4-1666b67a088b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 200 len: 1656 microversion: 2.20 time: 0.087972 Sep 15 12:27:57.247608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 213/408] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:57 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:27:57.297884 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-8fc79ad6-e8b0-47f6-9513-a95146b4be6e req-f205e31b-316c-40de-a7b4-dc1bf1ada51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e2f44-79df-47c0-b85d-68b4b96e4590", "name": "network-vif-deleted", "tag": "d1879643-5968-44a1-9897-dfed95801b5f"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:57.308083 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-8fc79ad6-e8b0-47f6-9513-a95146b4be6e req-f205e31b-316c-40de-a7b4-dc1bf1ada51d service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:57.308553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-8fc79ad6-e8b0-47f6-9513-a95146b4be6e req-f205e31b-316c-40de-a7b4-dc1bf1ada51d service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:57.309001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-8fc79ad6-e8b0-47f6-9513-a95146b4be6e req-f205e31b-316c-40de-a7b4-dc1bf1ada51d service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:57.322867 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-8fc79ad6-e8b0-47f6-9513-a95146b4be6e req-f205e31b-316c-40de-a7b4-dc1bf1ada51d service nova] Creating event network-vif-deleted:d1879643-5968-44a1-9897-dfed95801b5f for instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 on hv-cinder-85083 Sep 15 12:27:57.327641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-8fc79ad6-e8b0-47f6-9513-a95146b4be6e req-f205e31b-316c-40de-a7b4-dc1bf1ada51d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033457 Sep 15 12:27:57.328247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 196/409] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:27:58.275869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:58.276562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:27:58.283391 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:58.283951 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:58.284457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:58.285315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:27:58.285867 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:27:58.286352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:27:58.299937 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] HTTP exception thrown: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Request method failure captured: Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 HTTP/1.1 Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3e1DewPlMi-ZmxOoUaJ8LkO-TSBY00vV91hALh9_gTB3sTu2FmmqbFtC_QNYzCWlv8V8TYp7jQwr7L55K_odJQZqCJk7to4xwghwmKCwn8VF6eeDPHNTz3NOOSoB6DPQJqFWVXnzjLAJLI3yQCIT-kR3fRpXw3wm3mAEBg9bb8xg Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:27:58.301681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 1c42d5435a514bc0880b69fbbc163d32 Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:27:58.303270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'ad7e2f44-79df-47c0-b85d-68b4b96e4590'} Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:27:58.307548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:27:58.309196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:27:58.310483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Returning 404 to user: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:27:58.310483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b4401b36-55ce-4717-a74a-583a3acb3506 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 404 len: 111 microversion: 2.20 time: 0.031805 Sep 15 12:27:58.310483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 214/410] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:27:58 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:27:58.312864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5c2b7690-e97f-4d4e-956e-57d893506915 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '.version_select at 0x7ff0d063f940>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:27:58.331800 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5c2b7690-e97f-4d4e-956e-57d893506915 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832089907" status: 204 len: 0 microversion: 2.20 time: 0.023442 Sep 15 12:27:58.332365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 197/411] 10.222.0.15 () {60 vars in 1262 bytes} [Thu Sep 15 12:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832089907 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 12:27:58.946652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2062233d-4dc8-410f-a587-72727cb74f81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'create', calling method: .version_select at 0x7ff0d06ae8b0>, body: {"keypair": {"name": "tempest-keypair-1508200124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKAeCGNWUFtOm7hdMBtnhWg6CJ+4zHJOer6iV5LQJD3vqQH7u+PN5e5qUcIxOPknP5lGyHM+pT9IEo6Z8KYxRT4YsYwnt8f4nobRAeI7Tmp32D6oZj+sETUvcfJ7gX5ig=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:27:58.964432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-2062233d-4dc8-410f-a587-72727cb74f81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:27:58.968477 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-2062233d-4dc8-410f-a587-72727cb74f81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for user 1c42d5435a514bc0880b69fbbc163d32 and project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:27:58.990282 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2062233d-4dc8-410f-a587-72727cb74f81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047490 Sep 15 12:27:58.991064 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 215/412] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Sep 15 12:27:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 12:28:00.226049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1418622001", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b56cc68-11e6-40a5-bab2-e9f397e521ee"}], "security_groups": [{"name": "tempest-securitygroup--1199542027"}], "key_name": "tempest-keypair-1508200124", "user_data": "}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:00.331111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] validate_networks() for [('0b56cc68-11e6-40a5-bab2-e9f397e521ee', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:28:00.697913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:28:00.698373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:28:00.698843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:28:00.699252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:28:00.699664 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:28:00.708373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:00.708879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:00.709315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:00.710030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:00.710480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:00.710901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:00.730922 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:28:00.735043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Getting quotas for user 1c42d5435a514bc0880b69fbbc163d32 and project 8d77a46e3c75435ca3632e12a4cb642e. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:28:00.746538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:28:00.748939 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:28:00.795733 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a7fa2485-67b6-42fc-aadd-94b6f3c7db6b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.574510 Sep 15 12:28:00.796309 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 198/413] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Sep 15 12:28:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 12:28:00.808565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ce19e101-9f54-4b05-8e48-960d9ed45b5d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:00.809207 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ce19e101-9f54-4b05-8e48-960d9ed45b5d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:00.863895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ce19e101-9f54-4b05-8e48-960d9ed45b5d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:00.871855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ce19e101-9f54-4b05-8e48-960d9ed45b5d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:00.873361 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ce19e101-9f54-4b05-8e48-960d9ed45b5d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:00.874458 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ce19e101-9f54-4b05-8e48-960d9ed45b5d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1282 microversion: 2.20 time: 0.070925 Sep 15 12:28:00.875014 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 216/414] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:00 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:01.898681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:01.899223 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:01.905771 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:01.906286 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:01.906726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:01.907416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:01.907867 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:01.908289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:01.984259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:01.992598 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:01.994695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:01.996023 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8040fda1-7579-48a6-8410-cafaa4ac9b26 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1334 microversion: 2.20 time: 0.101484 Sep 15 12:28:02.009124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 199/415] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:01 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:03.021810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:03.022425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:03.029989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:03.030472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:03.030908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:03.031606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:03.032056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:03.032483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:03.162716 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:03.171107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:03.172589 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:03.173768 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8bfa2215-a907-44da-a3b4-3c085deb5609 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.155875 Sep 15 12:28:03.174313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 217/416] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:03 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:03.305703 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-5db7ef7f-b421-473f-995c-7a1a59a798c7 req-aee26a1c-7206-4195-b1ae-7f3acbbca73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:03.318645 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5db7ef7f-b421-473f-995c-7a1a59a798c7 req-aee26a1c-7206-4195-b1ae-7f3acbbca73a service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:03.319159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5db7ef7f-b421-473f-995c-7a1a59a798c7 req-aee26a1c-7206-4195-b1ae-7f3acbbca73a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:03.320096 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5db7ef7f-b421-473f-995c-7a1a59a798c7 req-aee26a1c-7206-4195-b1ae-7f3acbbca73a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:03.332582 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-5db7ef7f-b421-473f-995c-7a1a59a798c7 req-aee26a1c-7206-4195-b1ae-7f3acbbca73a service nova] Creating event network-changed:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:28:03.337383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-5db7ef7f-b421-473f-995c-7a1a59a798c7 req-aee26a1c-7206-4195-b1ae-7f3acbbca73a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035302 Sep 15 12:28:03.338131 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 200/417] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:04.199911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:04.200520 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:04.207321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:04.207791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:04.208220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:04.208935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:04.209369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:04.209787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:04.334537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:04.343288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:04.344704 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:04.345803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-79b04096-59f7-43d3-999c-18952dae217d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.150279 Sep 15 12:28:04.346354 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 218/418] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:04 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:05.369959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:05.370681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:05.377469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:05.377943 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:05.378371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:05.379047 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:05.379491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:05.379911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:05.397486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:05.511072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:05.519937 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:05.521409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:05.522773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d9b8b013-05c6-4a04-93c8-2a5bd9a8a711 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.156780 Sep 15 12:28:05.523796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 201/419] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:05 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:05.918840 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74879c55-a06d-4398-89d3-9abeccf4a6b0"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:05.921207 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:05.927608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:05.928089 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:05.928527 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:05.929244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:05.929703 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:05.930131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:06.164004 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b6d65ce7-1a25-49d0-8534-c59f7acdef70 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249499 Sep 15 12:28:06.164647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 219/420] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:28:05 2022] POST /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:06.549218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:06.549918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:06.557291 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:06.557777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:06.558237 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:06.558925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:06.559379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:06.559804 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:06.687248 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:06.695346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:06.696843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:06.697951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-37de019b-777d-4ff2-b504-86915ddc5360 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.152732 Sep 15 12:28:06.698511 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 202/421] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:06 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:07.723830 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:07.724534 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:07.730799 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:07.731277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:07.731712 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:07.732407 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:07.732888 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:07.733314 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:07.867193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:07.870003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:07.877252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:07.878681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:07.879782 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5076dbc9-6071-480c-97f9-2cfe45141c9d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.160837 Sep 15 12:28:07.880339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 220/422] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:07 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:08.905279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:08.905872 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:08.908154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:08.913566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:08.914040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:08.914471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:08.915663 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:08.916109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:08.916526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:09.046353 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:09.054882 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:09.057448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:09.058966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b046f14e-1451-40c0-a5ae-751598322b49 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.158002 Sep 15 12:28:09.059528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 203/423] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:08 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:28:09.529688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-30a5e45c-ee3e-47ca-a050-beab144b9039 req-8b7fe8e9-8029-4007-b7f4-0c4eceed1e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "name": "network-vif-plugged", "status": "completed", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:09.542216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-30a5e45c-ee3e-47ca-a050-beab144b9039 req-8b7fe8e9-8029-4007-b7f4-0c4eceed1e52 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:09.542997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-30a5e45c-ee3e-47ca-a050-beab144b9039 req-8b7fe8e9-8029-4007-b7f4-0c4eceed1e52 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:09.543429 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-30a5e45c-ee3e-47ca-a050-beab144b9039 req-8b7fe8e9-8029-4007-b7f4-0c4eceed1e52 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:09.554506 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-30a5e45c-ee3e-47ca-a050-beab144b9039 req-8b7fe8e9-8029-4007-b7f4-0c4eceed1e52 service nova] Creating event network-vif-plugged:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:28:09.560195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-30a5e45c-ee3e-47ca-a050-beab144b9039 req-8b7fe8e9-8029-4007-b7f4-0c4eceed1e52 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035470 Sep 15 12:28:09.561138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 221/424] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:28:10.083645 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:10.084183 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:10.090873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:10.091361 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:10.091792 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:10.092496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:10.092976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:10.093402 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:10.221853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:10.230317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:10.231755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:10.232892 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0ad2fdcb-87fe-49ee-bc4c-1cf8b0e9ef81 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.153199 Sep 15 12:28:10.233451 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 204/425] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:10 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:11.258322 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:11.259067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:11.261497 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:11.262141 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:11.268389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:11.268886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:11.269318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:11.270000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:11.270443 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:11.270863 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:11.412775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:11.422089 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:11.423522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:11.424624 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-314c835f-0223-46e7-be63-d69f8b8395e4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1408 microversion: 2.20 time: 0.170521 Sep 15 12:28:11.425205 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 222/426] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:11 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:12.449714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:12.451058 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:12.453317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:12.454036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=6 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:12.460420 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.460949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.461387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.463213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.463668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.464091 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.608609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:12.616530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:12.618578 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:12.619733 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-62a6f919-eb11-45f8-b505-336984f9fdc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1600 microversion: 2.20 time: 0.174572 Sep 15 12:28:12.620295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 205/427] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:12 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:12.643946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:12.644476 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:12.650783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.651256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.651681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.652358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.652819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.653267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.654897 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:12.657121 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:12.663472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.664054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.664599 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.665889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.666423 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.666917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.690201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'flavor' on Instance uuid ec9877ba-00fe-4496-89ec-e9b98befa363 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:28:12.734131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-68e2d3ef-0b5c-45c9-84c3-d6e3c10f925c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093952 Sep 15 12:28:12.734810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 223/428] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Sep 15 12:28:12 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:28:12.816310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-85774c13-0c8c-416a-8f0a-513dd1fc65f9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/action" status: 200 len: 32 microversion: 2.1 time: 0.165287 Sep 15 12:28:12.817707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 206/429] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:28:12 2022] POST /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:28:12.826475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:12.827098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:12.833280 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.833766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.834400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:12.835098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:12.835547 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:12.835966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:13.271305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:13.279847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e9943eb2-658c-42d3-b4f0-3768bf3c697e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.457082 Sep 15 12:28:13.280432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 224/430] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:12 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:13.965151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-6e786ef4-9f9c-47a2-9baf-f0b43af18336 req-17c90a7f-0277-429c-b883-ed1c826e35bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:13.975565 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-6e786ef4-9f9c-47a2-9baf-f0b43af18336 req-17c90a7f-0277-429c-b883-ed1c826e35bf service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:13.976048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-6e786ef4-9f9c-47a2-9baf-f0b43af18336 req-17c90a7f-0277-429c-b883-ed1c826e35bf service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:13.976479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-6e786ef4-9f9c-47a2-9baf-f0b43af18336 req-17c90a7f-0277-429c-b883-ed1c826e35bf service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:13.988239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-6e786ef4-9f9c-47a2-9baf-f0b43af18336 req-17c90a7f-0277-429c-b883-ed1c826e35bf service nova] Creating event network-changed:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:28:13.993348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-6e786ef4-9f9c-47a2-9baf-f0b43af18336 req-17c90a7f-0277-429c-b883-ed1c826e35bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033872 Sep 15 12:28:13.994024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 207/431] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:14.303304 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:14.303916 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:14.311754 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:14.312236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:14.312671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:14.313383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:14.313835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:14.314260 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:14.452046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:14.466894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2a5a59e6-043f-48a3-ae86-66844b658454 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.167134 Sep 15 12:28:14.468365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 225/432] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:14 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:15.491733 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:15.492433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:15.498552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:15.499032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:15.499468 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:15.500152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:15.500601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:15.501051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:15.629226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:15.637876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-16ccdb8b-0332-4e2f-bd8b-dac25ac57a8e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.150840 Sep 15 12:28:15.638437 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 208/433] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:15 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:16.661451 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:16.662063 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:16.669766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:16.670248 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:16.670684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:16.671369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:16.671821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:16.672242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:16.797626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:16.805845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2a66e352-4a40-4661-802f-769de0d695e7 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.148212 Sep 15 12:28:16.806416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 226/434] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:16 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:17.584621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:17.586829 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:17.593541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.594023 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.594464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.595153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.595605 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.596031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.624615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fb2bed97-f93d-454d-adb2-e36eed040442 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043887 Sep 15 12:28:17.625196 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 209/435] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:28:17 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:28:17.687882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:17.688376 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:17.694671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.695149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.695581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.696288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.696731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.697170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.723045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:28:17.795936 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8411698d-30ff-4c40-a179-fbb8b9327a1a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 204 len: 0 microversion: 2.1 time: 0.111439 Sep 15 12:28:17.796678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 227/436] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:28:17 2022] DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:28:17.804667 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:17.805897 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:17.812173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.812687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.813148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.813832 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.814277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.814696 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.831472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:17.832169 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:17.838206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.838708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.839118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:17.839807 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:17.840254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:17.840966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:18.009581 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:18.013687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:18.017278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7775b5ff-256c-4b18-8950-0d4ee9e5b570 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1674 microversion: 2.1 time: 0.216369 Sep 15 12:28:18.017855 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 210/437] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:17 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:18.022101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-17e52023-62c1-4968-815c-3e0de7483ef9 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.194870 Sep 15 12:28:18.022658 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 228/438] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:17 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:19.040876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:19.041483 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:19.045711 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:19.046837 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:19.055430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:19.055430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:19.055822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:19.055938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:19.056325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:19.056520 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:19.056789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:19.057370 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:19.057648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:19.058105 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:19.058218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:19.058564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:19.249350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:19.252919 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:19.257497 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-062ffd62-0dee-4dc9-b26e-70b6b01cf95d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.215854 Sep 15 12:28:19.258081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 229/439] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:19 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:19.260539 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7b622a9b-365e-4968-848a-f4cd0ada8b4d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1674 microversion: 2.1 time: 0.224157 Sep 15 12:28:19.261130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 211/440] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:19 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:20.280874 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:20.282036 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:20.284995 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:20.285616 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:20.288636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:20.289144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:20.290085 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:20.290778 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:20.291428 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:20.291926 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:20.294708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:20.294708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:20.294980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:20.298515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:20.298515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:20.298515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:20.523045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:20.526407 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:20.531514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a07ed845-adaf-4f5a-903e-12d1056cc739 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 200 len: 1674 microversion: 2.1 time: 0.251649 Sep 15 12:28:20.532076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 212/441] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:20 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:20.535805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-314fdb0b-4507-42fd-a0d9-afbdfdf35391 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.258760 Sep 15 12:28:20.536452 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 230/442] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:20 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:20.725249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-0df53632-e9e7-4d6f-98d6-3f1383ef564e req-5f923020-9123-47af-bbec-3daf2ffc7740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4481d43d-2a44-4a3c-b167-2b99e195a673", "name": "network-vif-deleted", "tag": "7faf28c3-337f-487f-9e4b-3dc169341cac"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:20.735494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0df53632-e9e7-4d6f-98d6-3f1383ef564e req-5f923020-9123-47af-bbec-3daf2ffc7740 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:20.735990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0df53632-e9e7-4d6f-98d6-3f1383ef564e req-5f923020-9123-47af-bbec-3daf2ffc7740 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:20.736410 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0df53632-e9e7-4d6f-98d6-3f1383ef564e req-5f923020-9123-47af-bbec-3daf2ffc7740 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:20.749351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-0df53632-e9e7-4d6f-98d6-3f1383ef564e req-5f923020-9123-47af-bbec-3daf2ffc7740 service nova] Creating event network-vif-deleted:7faf28c3-337f-487f-9e4b-3dc169341cac for instance 4481d43d-2a44-4a3c-b167-2b99e195a673 on hv-cinder-85083 Sep 15 12:28:20.758864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-0df53632-e9e7-4d6f-98d6-3f1383ef564e req-5f923020-9123-47af-bbec-3daf2ffc7740 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036684 Sep 15 12:28:20.759504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 213/443] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:21.557630 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:21.558256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:21.566763 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:21.567462 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:21.568206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:21.568699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:21.569287 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:21.569882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:21.570485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:21.571229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:21.574016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:21.574664 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:21.575113 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:21.576906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:21.576906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:21.576906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:21.585885 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] HTTP exception thrown: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Request method failure captured: Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 HTTP/1.1 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3tV42vMnwxSRYlw5nf-HNo_-qCe_-uSIXG9LW3ZYfjrgZXd-lL7nrNtOYzkELNatgFpVfaKZB1fZwaH5EkNt3w_5SqZ3wRuqQG7gE9dLwHgabgheaSO0lGim3rHT1lAVbawxCnSh9R1KUXJ4y6jHDxbKlPwTZSNanjol__zijEj4 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:28:21.587613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 89cc4de76c6a4305af9a9506840e13f6 Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:28:21.588925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '4481d43d-2a44-4a3c-b167-2b99e195a673'} Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:28:21.589678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:28:21.592118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:28:21.594263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Returning 404 to user: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:28:21.594263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a33f27d8-d8e1-407c-92e7-85ffa82faf59 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 404 len: 111 microversion: 2.1 time: 0.035957 Sep 15 12:28:21.594263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 231/444] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:21 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:28:21.598075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-47cc758a-a125-4409-92c2-2f9177bd28a3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '.version_select at 0x7ff0d0666280>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:21.619548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-47cc758a-a125-4409-92c2-2f9177bd28a3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999682757" status: 202 len: 0 microversion: 2.1 time: 0.025004 Sep 15 12:28:21.620164 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 232/445] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 15 12:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999682757 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:28:21.719077 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:21.728538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2e3bc7d5-5513-4921-a093-2bb6a94baf29 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.166338 Sep 15 12:28:21.729141 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 214/446] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:21 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:22.241592 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c81f28a1-4e8e-49c7-bed2-6b2f14ba62bd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: .version_select at 0x7ff0d0523310>, body: {"keypair": {"name": "tempest-keypair-285837333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvjI8mjh0+MZbzNmBoohmaOVJ+SuB01u3h0TGJr48FNpsv2d9I+/NQk7wqVmuaB7NbPW1w8wZEu9WifFnPEUW7jEg6rOmYXYDlB2Wa+18H+8WP2dZ/c2hNdQUqHvVFY1A=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:22.258216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-c81f28a1-4e8e-49c7-bed2-6b2f14ba62bd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:28:22.262226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-c81f28a1-4e8e-49c7-bed2-6b2f14ba62bd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for user 89cc4de76c6a4305af9a9506840e13f6 and project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:28:22.283957 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c81f28a1-4e8e-49c7-bed2-6b2f14ba62bd tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046221 Sep 15 12:28:22.284585 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 233/447] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:28:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:22.752256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:22.753229 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:22.760464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:22.760968 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:22.761402 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:22.762086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:22.762530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:22.762942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:22.891240 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:22.899549 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9ea48f9b-da0f-4e16-8420-63e5385d2a99 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.151174 Sep 15 12:28:22.900127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 215/448] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:22 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:23.519471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-247443681", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac718f64-2120-48e0-8b5c-3a613680e04c"}], "security_groups": [{"name": "tempest-securitygroup--370329945"}], "key_name": "tempest-keypair-285837333", "user_data": "}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:23.622587 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] validate_networks() for [('ac718f64-2120-48e0-8b5c-3a613680e04c', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:28:23.923334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:23.923944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:23.931014 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:23.931487 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:23.931923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:23.932601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:23.933117 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:23.933534 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:23.996369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:28:23.996823 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:28:23.997300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:28:23.997709 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:28:23.998117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:28:24.006657 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:24.007130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:24.007556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:24.008820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:24.009268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:24.009689 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:24.026450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:28:24.030369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Getting quotas for user 89cc4de76c6a4305af9a9506840e13f6 and project d2780dab9a5d40739fc9adc9a6ce35a1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:28:24.041254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:28:24.043548 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:28:24.083115 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:24.091478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-dab449c3-b9a0-4661-a07f-1c1380f9a06e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.171937 Sep 15 12:28:24.092051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 216/449] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:23 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:24.094298 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2c119d0a-e515-495c-bd27-c605088cc0ec tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.579006 Sep 15 12:28:24.095264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 234/450] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:28:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:28:24.108681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-91866783-b892-4b78-b79d-fce7d9af2396 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:24.110188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-91866783-b892-4b78-b79d-fce7d9af2396 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:24.163098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-91866783-b892-4b78-b79d-fce7d9af2396 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:24.170454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-91866783-b892-4b78-b79d-fce7d9af2396 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1236 microversion: 2.1 time: 0.065475 Sep 15 12:28:24.171018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 217/451] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:24 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:24.877648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:24.878176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:24.885629 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:24.886115 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:24.886551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:24.887246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:24.887698 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:24.888123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:24.913224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2411630b-ed03-4737-a3df-e7e21819b7bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/ips" status: 200 len: 150 microversion: 2.1 time: 0.041265 Sep 15 12:28:24.913788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 235/452] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:28:24 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:28:25.114045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:25.114662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:25.122401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:25.122778 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:25.123569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:25.124409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:25.125270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:25.125873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:25.180729 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:25.193197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:25.194139 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:25.203475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:25.204007 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:25.204359 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:25.205072 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:25.205544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:25.206018 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:25.291623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:25.302177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-15dd22e3-3850-45f1-a840-9a3b44393341 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1288 microversion: 2.1 time: 0.112729 Sep 15 12:28:25.303001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 236/453] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:25 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:25.331837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:25.341059 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a32e5282-259c-4cb8-b2fd-2229f35e00ee tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1735 microversion: 2.1 time: 0.230820 Sep 15 12:28:25.341632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 218/454] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:25 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:26.271816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a9b6060-1d7e-479d-8f53-015d0639f7bf"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:26.274342 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:26.280673 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.281176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.281607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.282281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.282728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.283147 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.325465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:26.326074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:26.332533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.333043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.333476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.334157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.334636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.335053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.399252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:26.407104 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-967e89a8-fadc-4fe0-a8c8-691c14ee3d25 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1296 microversion: 2.1 time: 0.085443 Sep 15 12:28:26.407746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 219/455] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:26 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:26.412280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:26.412905 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:26.419567 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.420219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.420871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.421847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.422304 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.422876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.550900 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:26.560448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-70ab564e-03f1-4c7c-8870-a3225ca6eb7e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1715 microversion: 2.1 time: 0.151729 Sep 15 12:28:26.561060 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 220/456] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:26 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:26.633175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:26.633916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:26.640741 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.641525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.642143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.643133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.643809 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.644456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.802278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] HTTP exception thrown: Cannot 'detach_volume' instance ec9877ba-00fe-4496-89ec-e9b98befa363 while it is in vm_state rescued Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Request method failure captured: Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments/74879c55-a06d-4398-89d3-9abeccf4a6b0 HTTP/1.1 Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxnB7wsCgruitXr_kJPgwhJtMaLy8atHs9pEDm71ipisUq8tht_i3pDfoIWi9GgGVnStKpeQ_I-l8Ny-Y1lJx_w7YV9xJZF3obfue8Dg2QT-VGJ1mko7WEr41DbLwHOuxNnP2JfLJNlddSyFX3y2XpPKwgIwHgREGbs49h_B4r2VeNM Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:28:26.804276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22801aa5908b4b098931d2588433e9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22801aa5908b4b098931d2588433e9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 20ca976222454c6c898d0e4b170b41fc Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:28:26.805879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Cannot 'detach_volume' instance ec9877ba-00fe-4496-89ec-e9b98befa363 while it is in vm_state rescued Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'server_id': 'ec9877ba-00fe-4496-89ec-e9b98befa363', 'id': '74879c55-a06d-4398-89d3-9abeccf4a6b0'} Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:28:26.806669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ec9877ba-00fe-4496-89ec-e9b98befa363 while it is in vm_state rescued Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ec9877ba-00fe-4496-89ec-e9b98befa363 while it is in vm_state rescued Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:26.808592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Returning 409 to user: Cannot 'detach_volume' instance ec9877ba-00fe-4496-89ec-e9b98befa363 while it is in vm_state rescued {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:28:26.809957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e5067a9d-2744-4a3b-bd36-ff53236b1925 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments/74879c55-a06d-4398-89d3-9abeccf4a6b0" status: 409 len: 152 microversion: 2.1 time: 0.176735 Sep 15 12:28:26.809957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 221/457] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:28:26 2022] DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments/74879c55-a06d-4398-89d3-9abeccf4a6b0 => generated 152 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 15 12:28:26.812416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-97dab60f-51a4-40f6-873b-91b65650ce09 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544387 Sep 15 12:28:26.814768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:26.815313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:26.818919 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 237/458] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:28:26 2022] POST /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:26.829236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.830117 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.830497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.831372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.831843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.832274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.907533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-abe03675-a1d9-4283-8911-9ed91e1af304 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "POST /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/action" status: 202 len: 0 microversion: 2.1 time: 0.096381 Sep 15 12:28:26.908152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 222/459] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:28:26 2022] POST /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:28:26.917226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:26.917929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:26.923976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.924458 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.924991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:26.925673 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:26.926121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:26.926544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:27.275397 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:27.284251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f8555455-bb9c-46e8-890b-59c28f23b1e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1723 microversion: 2.1 time: 0.371692 Sep 15 12:28:27.285015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 238/460] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:26 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:27.431903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:27.432731 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:27.440600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:27.441428 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:27.442145 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:27.443052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:27.443693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:27.444320 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:27.509176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:27.516743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7bb0e5dc-18e6-4971-8e87-e589f52e6afe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1294 microversion: 2.1 time: 0.089740 Sep 15 12:28:27.517332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 223/461] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:27 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:28.309312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:28.310355 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:28.316962 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:28.317447 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:28.317884 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:28.318579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:28.319026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:28.319453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:28.323682 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:28.457169 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:28.466123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d7a7fb0a-647f-45a7-9ba2-8bcb77e221dd tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1723 microversion: 2.1 time: 0.161248 Sep 15 12:28:28.466702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 239/462] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:28 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:28.540504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:28.541088 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:28.548127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:28.548633 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:28.549077 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:28.550010 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:28.550550 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:28.551044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:28.574576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-5b6515a9-0e52-41fc-a0d1-55efcd6a1ac9 req-32832b34-3202-4dc3-9108-1eabc63a700b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e31c4e-af5d-494f-a84b-d6be20a1bb86", "tag": "36d013e2-79cd-4a77-80e6-66f26edcdd2b"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:28.585115 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5b6515a9-0e52-41fc-a0d1-55efcd6a1ac9 req-32832b34-3202-4dc3-9108-1eabc63a700b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:28.586344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5b6515a9-0e52-41fc-a0d1-55efcd6a1ac9 req-32832b34-3202-4dc3-9108-1eabc63a700b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:28.587050 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5b6515a9-0e52-41fc-a0d1-55efcd6a1ac9 req-32832b34-3202-4dc3-9108-1eabc63a700b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:28.598757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-5b6515a9-0e52-41fc-a0d1-55efcd6a1ac9 req-32832b34-3202-4dc3-9108-1eabc63a700b service nova] Creating event network-changed:36d013e2-79cd-4a77-80e6-66f26edcdd2b for instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 on hv-cinder-85083 Sep 15 12:28:28.607517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-5b6515a9-0e52-41fc-a0d1-55efcd6a1ac9 req-32832b34-3202-4dc3-9108-1eabc63a700b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036903 Sep 15 12:28:28.608893 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 240/463] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:28:28.700299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:28.707868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-afb0c85e-2484-4466-9532-55c78cd5765f tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.171897 Sep 15 12:28:28.708429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 224/464] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:28 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:29.491297 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:29.492051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:29.498144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:29.498623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:29.499055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:29.499733 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:29.500183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:29.500607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:29.627512 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:29.635752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3fb50eb7-b5c5-4f65-a037-b91de3f403e6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1723 microversion: 2.1 time: 0.149057 Sep 15 12:28:29.636257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 241/465] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:29 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:29.730861 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:29.731468 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:29.737840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:29.738313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:29.738742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:29.739417 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:29.739861 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:29.740274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:29.867913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:29.875491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8ca4d139-9d30-4ced-8879-40319e52d4f1 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.148435 Sep 15 12:28:29.876056 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 225/466] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:29 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:30.659472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:30.660041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:30.667336 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:30.667810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:30.668241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:30.669033 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:30.669486 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:30.669906 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:30.797351 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:30.806267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b21b17af-8fa8-46c5-a029-d88a865f59f6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1729 microversion: 2.1 time: 0.150686 Sep 15 12:28:30.806835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 242/467] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:30 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:30.828392 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:30.828973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:30.835316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:30.836321 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:30.836801 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:30.837503 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:30.837949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:30.838369 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:30.897663 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:30.898829 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:30.904767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:30.905267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:30.905704 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:30.906398 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:30.906849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:30.907276 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:30.916506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bf88fdb1-1203-4156-80e0-9d1c89c66483 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091286 Sep 15 12:28:30.917254 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 226/468] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:28:30 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:31.134946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:31.142557 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d2e367c0-8bfe-47cd-86a8-72ed188ac328 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.248774 Sep 15 12:28:31.143135 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 243/469] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:30 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:31.850679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-d55b5084-768b-4181-8835-811632f83221 req-26d43f83-4508-45d6-9d9f-551f70ed3e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9877ba-00fe-4496-89ec-e9b98befa363", "tag": "3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:31.861554 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d55b5084-768b-4181-8835-811632f83221 req-26d43f83-4508-45d6-9d9f-551f70ed3e4f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:31.862549 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d55b5084-768b-4181-8835-811632f83221 req-26d43f83-4508-45d6-9d9f-551f70ed3e4f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:31.863051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d55b5084-768b-4181-8835-811632f83221 req-26d43f83-4508-45d6-9d9f-551f70ed3e4f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:31.875365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-d55b5084-768b-4181-8835-811632f83221 req-26d43f83-4508-45d6-9d9f-551f70ed3e4f service nova] Creating event network-changed:3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3 for instance ec9877ba-00fe-4496-89ec-e9b98befa363 on hv-cinder-85083 Sep 15 12:28:31.880278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-d55b5084-768b-4181-8835-811632f83221 req-26d43f83-4508-45d6-9d9f-551f70ed3e4f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033955 Sep 15 12:28:31.880966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 227/470] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:32.166464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:32.167680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:32.176095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:32.176895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:32.177717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:32.178595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:32.179051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:32.179501 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:32.323560 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:32.331625 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-faa17c90-2414-4824-9225-aa598c237cef tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.170523 Sep 15 12:28:32.332221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 244/471] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:32 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:33.355852 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:33.356552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:33.363085 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:33.363571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:33.364007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:33.364727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:33.365213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:33.365659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:33.505439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:33.514239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-04bf8599-c11c-43d0-a836-387f06e52bc4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.163116 Sep 15 12:28:33.514817 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 228/472] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:33 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:33.895192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-541c2877-ce38-4f0e-88e4-b34825e2cbd5 req-fadf6f73-a23f-41b4-a21e-1e84e2593bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9877ba-00fe-4496-89ec-e9b98befa363", "tag": "3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:33.905406 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-541c2877-ce38-4f0e-88e4-b34825e2cbd5 req-fadf6f73-a23f-41b4-a21e-1e84e2593bbe service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:33.905879 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-541c2877-ce38-4f0e-88e4-b34825e2cbd5 req-fadf6f73-a23f-41b4-a21e-1e84e2593bbe service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:33.906304 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-541c2877-ce38-4f0e-88e4-b34825e2cbd5 req-fadf6f73-a23f-41b4-a21e-1e84e2593bbe service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:33.917715 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-541c2877-ce38-4f0e-88e4-b34825e2cbd5 req-fadf6f73-a23f-41b4-a21e-1e84e2593bbe service nova] Creating event network-changed:3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3 for instance ec9877ba-00fe-4496-89ec-e9b98befa363 on hv-cinder-85083 Sep 15 12:28:33.922454 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-541c2877-ce38-4f0e-88e4-b34825e2cbd5 req-fadf6f73-a23f-41b4-a21e-1e84e2593bbe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Sep 15 12:28:33.923048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 245/473] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:34.374869 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a9b6060-1d7e-479d-8f53-015d0639f7bf"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:34.377428 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:34.379899 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:34.388994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.389559 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.389998 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.390714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.391167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.391592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.474601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Invalid volume: volume 0a9b6060-1d7e-479d-8f53-015d0639f7bf is already attached to instances: e0bbaa77-aba7-4c9b-9777-91f17808f77f Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: POST /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments HTTP/1.1 Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 74 Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:28:34.476315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {"volumeAttachment": {"volumeId": "0a9b6060-1d7e-479d-8f53-015d0639f7bf"}} Sep 15 12:28:34.477896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Invalid volume: volume 0a9b6060-1d7e-479d-8f53-015d0639f7bf is already attached to instances: e0bbaa77-aba7-4c9b-9777-91f17808f77f Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'server_id': 'e0bbaa77-aba7-4c9b-9777-91f17808f77f', 'body': {'volumeAttachment': {'volumeId': '0a9b6060-1d7e-479d-8f53-015d0639f7bf'}}} Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a9b6060-1d7e-479d-8f53-015d0639f7bf is already attached to instances: e0bbaa77-aba7-4c9b-9777-91f17808f77f Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:34.478851 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a9b6060-1d7e-479d-8f53-015d0639f7bf is already attached to instances: e0bbaa77-aba7-4c9b-9777-91f17808f77f Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:34.480252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a9b6060-1d7e-479d-8f53-015d0639f7bf is already attached to instances: e0bbaa77-aba7-4c9b-9777-91f17808f77f Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 400 to user: Invalid volume: volume 0a9b6060-1d7e-479d-8f53-015d0639f7bf is already attached to instances: e0bbaa77-aba7-4c9b-9777-91f17808f77f {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fc403543-51f2-418c-b8be-2f34357ce579 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107311 Sep 15 12:28:34.481796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 229/474] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:28:34 2022] POST /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 12:28:34.534165 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:34.535038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=10 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:34.539327 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:34.540040 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:34.543681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:34.544173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:34.547172 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.547658 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.548096 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.548803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.549269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.549693 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.549974 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.550446 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.550869 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.551543 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.551984 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.552398 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.634592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lazy-loading 'services' on Instance uuid e0bbaa77-aba7-4c9b-9777-91f17808f77f {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:28:34.683435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:34.691125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ee332916-7a42-42e8-b0f5-a8ceb3ee2e5a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.157889 Sep 15 12:28:34.691824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 246/475] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:34 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:34.751916 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f6a90f66-8067-4d3c-a955-6a3d42bcac42 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments/0a9b6060-1d7e-479d-8f53-015d0639f7bf" status: 202 len: 0 microversion: 2.1 time: 0.212149 Sep 15 12:28:34.752506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 230/476] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:28:34 2022] DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments/0a9b6060-1d7e-479d-8f53-015d0639f7bf => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 12:28:34.761957 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:34.764288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:34.770637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.771118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.771580 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.772465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:34.773070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:34.773556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:34.806186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-81813fde-b2f5-4a61-9daa-68155443d32f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049242 Sep 15 12:28:34.806744 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 247/477] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:28:34 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:35.620958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-c7a9da39-f7aa-420a-a891-a070275dd593 req-cb3e19cd-954b-497c-af13-6565b66c48ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e31c4e-af5d-494f-a84b-d6be20a1bb86", "name": "network-vif-plugged", "status": "completed", "tag": "36d013e2-79cd-4a77-80e6-66f26edcdd2b"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:35.631289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c7a9da39-f7aa-420a-a891-a070275dd593 req-cb3e19cd-954b-497c-af13-6565b66c48ab service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.631767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c7a9da39-f7aa-420a-a891-a070275dd593 req-cb3e19cd-954b-497c-af13-6565b66c48ab service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.632195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c7a9da39-f7aa-420a-a891-a070275dd593 req-cb3e19cd-954b-497c-af13-6565b66c48ab service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.643562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-c7a9da39-f7aa-420a-a891-a070275dd593 req-cb3e19cd-954b-497c-af13-6565b66c48ab service nova] Creating event network-vif-plugged:36d013e2-79cd-4a77-80e6-66f26edcdd2b for instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 on hv-cinder-85083 Sep 15 12:28:35.648368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-c7a9da39-f7aa-420a-a891-a070275dd593 req-cb3e19cd-954b-497c-af13-6565b66c48ab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Sep 15 12:28:35.649003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 231/478] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:35.715105 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:35.715905 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:35.725315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.725801 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.727817 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.728913 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.730308 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.730825 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.819366 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:35.822436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:35.828903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.829724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.830224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.830982 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.831614 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.832160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.867164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f44565d8-dc0b-46ef-86e0-57223a55957f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052163 Sep 15 12:28:35.868542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 232/479] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:28:35 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:28:35.884133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:35.892452 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ed910bd3-c650-4b2e-9d09-b6a4b3a8fafb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.181461 Sep 15 12:28:35.893072 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 248/480] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:35 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:35.938667 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:35.939162 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:35.945185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.945662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.946146 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.946823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:35.947269 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:35.947691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:35.973069 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Going to try to terminate instance {{(pid=120436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:28:36.020153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:36.054362 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-07f8f196-f42d-41fc-8a59-ba8621a0ad80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 204 len: 0 microversion: 2.1 time: 0.119303 Sep 15 12:28:36.054944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 233/481] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:28:35 2022] DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:28:36.063572 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:36.064180 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:36.070100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:36.070567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:36.070996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:36.071668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:36.072116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:36.072531 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:36.198783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:36.206660 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2ed98115-2c8b-4db4-866a-3867a93cbfe0 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1679 microversion: 2.1 time: 0.146863 Sep 15 12:28:36.207229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 249/482] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:36 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:36.917947 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:36.918557 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:36.925145 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:36.925873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:36.926389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:36.927114 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:36.927785 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:36.928284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:37.060546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:37.069207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-24689380-1f01-4ad7-a1c8-6a32f0caa9da tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.155495 Sep 15 12:28:37.069787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 234/483] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:36 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:37.230878 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:37.231502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:37.237960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:37.238436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:37.238878 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:37.239635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:37.240087 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:37.240518 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:37.366522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:37.374790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-29ed3a5b-33f0-4923-8703-7ed0fc53c85a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1679 microversion: 2.1 time: 0.148302 Sep 15 12:28:37.375367 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 250/484] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:37 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:38.094057 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:38.094755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:38.101002 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:38.101474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:38.101903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:38.102579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:38.103024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:38.103442 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:38.231160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:38.247427 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-660b7fb0-c645-4977-962f-87023b9158e2 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1361 microversion: 2.1 time: 0.157447 Sep 15 12:28:38.248257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 235/485] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:38 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:38.397745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:38.398356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:38.404798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:38.405284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:38.405717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:38.406426 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:38.406859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:38.407283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:38.542639 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:38.550633 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-14ef55b8-834b-4b65-a7b4-ea6eb574f637 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1679 microversion: 2.1 time: 0.156716 Sep 15 12:28:38.551204 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 251/486] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:38 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:38.986700 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-7b7620e4-d6fb-4430-a913-90f847cd2cca req-ac14c6d0-606b-407e-afbb-93cd561983fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bbaa77-aba7-4c9b-9777-91f17808f77f", "name": "network-vif-deleted", "tag": "3d96cacb-fcb2-430c-a166-5f75a66bc533"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:38.994089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:39.001224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-7b7620e4-d6fb-4430-a913-90f847cd2cca req-ac14c6d0-606b-407e-afbb-93cd561983fc service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.001900 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-7b7620e4-d6fb-4430-a913-90f847cd2cca req-ac14c6d0-606b-407e-afbb-93cd561983fc service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.002431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-7b7620e4-d6fb-4430-a913-90f847cd2cca req-ac14c6d0-606b-407e-afbb-93cd561983fc service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.022246 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-7b7620e4-d6fb-4430-a913-90f847cd2cca req-ac14c6d0-606b-407e-afbb-93cd561983fc service nova] Creating event network-vif-deleted:3d96cacb-fcb2-430c-a166-5f75a66bc533 for instance e0bbaa77-aba7-4c9b-9777-91f17808f77f on hv-cinder-85083 Sep 15 12:28:39.027608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-7b7620e4-d6fb-4430-a913-90f847cd2cca req-ac14c6d0-606b-407e-afbb-93cd561983fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045416 Sep 15 12:28:39.028810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 236/487] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:39.270529 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:39.271250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:39.278953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.278953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.279189 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.279721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.280176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.280609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.412541 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:39.420271 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-dafc3a5d-1e94-44a4-be79-40f6dc879ad3 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1547 microversion: 2.1 time: 0.153552 Sep 15 12:28:39.432499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 252/488] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:39 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:39.442871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:39.443471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:39.450795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.451276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.451704 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.452386 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.452858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.453274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.538214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6f19f6e0-8ed2-4f3c-913a-1e3ecf5603e7 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099542 Sep 15 12:28:39.538809 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 237/489] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:28:39 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:39.575889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:39.576801 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:39.584668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.585484 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.585926 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.587200 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.587886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.588465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.624831 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:39.625280 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:39.625993 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:39.626601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lazy-loading 'fault' on Instance uuid e0bbaa77-aba7-4c9b-9777-91f17808f77f {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:28:39.696510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:39.705357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6069bfe2-a2fa-403d-a35d-cdc9d56beb80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 200 len: 1331 microversion: 2.1 time: 0.134737 Sep 15 12:28:39.717065 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 253/490] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:39 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:40.729744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:40.730968 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:40.737481 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:40.737969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:40.738409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:40.739107 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:40.739564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:40.739993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:40.753337 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f HTTP/1.1 Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:28:40.754981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:28:40.756478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'e0bbaa77-aba7-4c9b-9777-91f17808f77f'} Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:28:40.757228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:28:40.758432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:28:40.759523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:28:40.759523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-38ad3a40-46c0-49a5-aa68-86f406f8aa2b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 404 len: 111 microversion: 2.1 time: 0.031012 Sep 15 12:28:40.759523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 238/491] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:40 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:28:40.768213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-da23ac4d-cd0a-464a-9f98-714eee15d93f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '.version_select at 0x7ff0d0584550>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:40.775949 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:40.791716 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-da23ac4d-cd0a-464a-9f98-714eee15d93f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685330976" status: 202 len: 0 microversion: 2.1 time: 0.027190 Sep 15 12:28:40.792400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 254/492] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 12:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685330976 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:28:41.052700 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-16563e63-dfb2-4c75-80c5-f4178ec2a166 req-c13f5ffc-23c6-4bf5-aedb-050002844bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e31c4e-af5d-494f-a84b-d6be20a1bb86", "tag": "36d013e2-79cd-4a77-80e6-66f26edcdd2b"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:41.061994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-16563e63-dfb2-4c75-80c5-f4178ec2a166 req-c13f5ffc-23c6-4bf5-aedb-050002844bc2 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:41.062471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-16563e63-dfb2-4c75-80c5-f4178ec2a166 req-c13f5ffc-23c6-4bf5-aedb-050002844bc2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:41.062888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-16563e63-dfb2-4c75-80c5-f4178ec2a166 req-c13f5ffc-23c6-4bf5-aedb-050002844bc2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:41.074648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-16563e63-dfb2-4c75-80c5-f4178ec2a166 req-c13f5ffc-23c6-4bf5-aedb-050002844bc2 service nova] Creating event network-changed:36d013e2-79cd-4a77-80e6-66f26edcdd2b for instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 on hv-cinder-85083 Sep 15 12:28:41.079670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-16563e63-dfb2-4c75-80c5-f4178ec2a166 req-c13f5ffc-23c6-4bf5-aedb-050002844bc2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030824 Sep 15 12:28:41.080460 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 239/493] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:41.934190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4e62076d-b00a-4fd6-b7a2-0947f3c35b2a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: .version_select at 0x7ff0d04d8b80>, body: {"keypair": {"name": "tempest-keypair-303028707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrBqT53xWKWbY3CoWKoEdTa1etKfUX7xUwcMq1ZYBgQlcg/hHvREOk17F+4dY4PSxV7YUwORQ2icJfXmkzn+KCM9+EMQMma+8G2VLbnVLOU1Bm0aoboJPfqHNdEx8V91w=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:41.950078 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-4e62076d-b00a-4fd6-b7a2-0947f3c35b2a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:28:41.953964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-4e62076d-b00a-4fd6-b7a2-0947f3c35b2a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:28:41.977673 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4e62076d-b00a-4fd6-b7a2-0947f3c35b2a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048200 Sep 15 12:28:41.978581 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 255/494] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:28:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:43.185987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-603721913", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1f39d5a-ab5e-4464-9fc6-537bb91606a6"}], "security_groups": [{"name": "tempest-securitygroup--1836906891"}], "key_name": "tempest-keypair-303028707", "user_data": "}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:43.287620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] validate_networks() for [('c1f39d5a-ab5e-4464-9fc6-537bb91606a6', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:28:43.648445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:28:43.649555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:28:43.650052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:28:43.650458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:28:43.650868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:28:43.659616 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:43.660088 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:43.660517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:43.661348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:43.661795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:43.662213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:43.679422 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:28:43.683333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Getting quotas for user 4ead4be9666942f2b81cbb0f9ab69325 and project 7a670696e63446e4bf597c40c6e72490. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:28:43.694247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:28:43.696611 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:28:43.743946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7d9ced71-70cd-4a6e-8fc9-70ce963ac35d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563622 Sep 15 12:28:43.744596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 240/495] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:28:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:28:43.756159 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-772a1985-28e9-45fc-b6b5-7dd8afc5091c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:43.756908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-772a1985-28e9-45fc-b6b5-7dd8afc5091c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:43.817431 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-772a1985-28e9-45fc-b6b5-7dd8afc5091c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:43.825866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-772a1985-28e9-45fc-b6b5-7dd8afc5091c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1240 microversion: 2.1 time: 0.073354 Sep 15 12:28:43.832362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 256/496] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:43 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:44.850371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:44.850981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:44.858421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:44.858908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:44.859343 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:44.860333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:44.860937 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:44.861472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:44.934068 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:44.943149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-72ac6ba9-7de7-4cac-9d3e-68ad89615cf2 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1292 microversion: 2.1 time: 0.097469 Sep 15 12:28:44.943732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 241/497] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:44 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:45.967153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:45.967774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:45.975012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:45.975758 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:45.976197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:45.976952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:45.977400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:45.977835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:46.107467 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:46.115198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ebce7c21-21b0-40b9-ad5d-600ef6053fc1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.152106 Sep 15 12:28:46.115785 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 257/498] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:45 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:46.353972 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-fcc7eb46-c2d9-4702-ac78-f485f50fd234 req-23b16ee8-9b49-4979-8e72-4d3aa338dae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03869400-86b1-4b64-9251-a4545e0ff757", "tag": "56455d96-1ad4-4de2-9be8-e8dcd1602622"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:46.364864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-fcc7eb46-c2d9-4702-ac78-f485f50fd234 req-23b16ee8-9b49-4979-8e72-4d3aa338dae4 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:46.365338 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-fcc7eb46-c2d9-4702-ac78-f485f50fd234 req-23b16ee8-9b49-4979-8e72-4d3aa338dae4 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:46.365765 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-fcc7eb46-c2d9-4702-ac78-f485f50fd234 req-23b16ee8-9b49-4979-8e72-4d3aa338dae4 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:46.382272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-fcc7eb46-c2d9-4702-ac78-f485f50fd234 req-23b16ee8-9b49-4979-8e72-4d3aa338dae4 service nova] Creating event network-changed:56455d96-1ad4-4de2-9be8-e8dcd1602622 for instance 03869400-86b1-4b64-9251-a4545e0ff757 on hv-cinder-85083 Sep 15 12:28:46.387306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-fcc7eb46-c2d9-4702-ac78-f485f50fd234 req-23b16ee8-9b49-4979-8e72-4d3aa338dae4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037695 Sep 15 12:28:46.388239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 242/499] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:47.139144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:47.139751 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:47.146179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:47.146639 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:47.147070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:47.147749 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:47.148201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:47.148622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:47.284198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:47.292086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1f317912-6a39-4a71-868e-a9869037ae3c tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.156801 Sep 15 12:28:47.292652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 258/500] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:47 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:28:48.315796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:48.316621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:48.323266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:48.323748 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:48.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:48.324912 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:48.325365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:48.325791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:48.452149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:48.459786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6a2dc9e1-d9c9-4e7e-af26-86e935f0b2cc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.148244 Sep 15 12:28:48.460358 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 243/501] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:48 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:49.483586 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:49.484195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:49.492394 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:49.493425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:49.493860 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:49.494741 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:49.495273 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:49.496015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:49.640106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:49.642401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=100 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:49.649070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fba1cd3c-0ec3-4437-8ba9-c463310f495b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.169624 Sep 15 12:28:49.649756 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 259/502] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:49 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:50.672543 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:50.673186 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:50.679570 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:50.680041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:50.680481 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:50.681182 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:50.681625 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:50.682040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:50.807913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:50.815540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c2225287-270a-4198-9fd5-f36e1ee1ec08 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.146935 Sep 15 12:28:50.816118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 244/503] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:50 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:51.665579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-861f3818-b566-4645-9f0a-17d669dc93f9 req-ba262270-fee6-4314-9d6a-15dbed597c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03869400-86b1-4b64-9251-a4545e0ff757", "name": "network-vif-plugged", "status": "completed", "tag": "56455d96-1ad4-4de2-9be8-e8dcd1602622"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:51.678010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-861f3818-b566-4645-9f0a-17d669dc93f9 req-ba262270-fee6-4314-9d6a-15dbed597c3a service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:51.678749 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-861f3818-b566-4645-9f0a-17d669dc93f9 req-ba262270-fee6-4314-9d6a-15dbed597c3a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:51.679187 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-861f3818-b566-4645-9f0a-17d669dc93f9 req-ba262270-fee6-4314-9d6a-15dbed597c3a service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:51.690805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-861f3818-b566-4645-9f0a-17d669dc93f9 req-ba262270-fee6-4314-9d6a-15dbed597c3a service nova] Creating event network-vif-plugged:56455d96-1ad4-4de2-9be8-e8dcd1602622 for instance 03869400-86b1-4b64-9251-a4545e0ff757 on hv-cinder-85083 Sep 15 12:28:51.696930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-861f3818-b566-4645-9f0a-17d669dc93f9 req-ba262270-fee6-4314-9d6a-15dbed597c3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035543 Sep 15 12:28:51.697741 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 260/504] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:51.838953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:51.839827 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:51.846279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:51.846764 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:51.847203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:51.847898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:51.848349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:51.848786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:51.934894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:51.935482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:51.941735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:51.942226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:51.942657 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:51.943356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:51.943812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:51.944262 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:51.968164 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-002783e3-a9ea-4cf3-9e6c-6cacb4206391 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/ips" status: 200 len: 152 microversion: 2.20 time: 0.037484 Sep 15 12:28:51.968747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 261/505] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Sep 15 12:28:51 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:28:51.984638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:51.992168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c2b9598f-8335-4dd1-bdf0-68775dca74f7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.157526 Sep 15 12:28:51.992734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 245/506] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:51 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:53.014828 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:53.015433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:53.022082 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:53.022564 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:53.023002 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:53.023684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:53.024130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:53.024550 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:53.151489 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:53.159052 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8dc85c64-58c8-40d8-a473-8d3eacf0a387 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1366 microversion: 2.1 time: 0.148081 Sep 15 12:28:53.159617 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 262/507] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:53 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:54.182841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:54.183586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:54.185989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:54.186638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=6 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:54.192551 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.193054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.193486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.194217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.194739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.195163 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.321205 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:54.330068 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-dc6bb71c-53db-427d-8f0c-aaf215c0a9c7 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1557 microversion: 2.1 time: 0.151611 Sep 15 12:28:54.330630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 246/508] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:28:54 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:28:54.353912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:54.354427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:54.356444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:54.362031 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.362504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.362931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.363605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.364051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.364466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.443774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a85c0ef9-1cf7-4d7d-9452-c32d40178201 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094099 Sep 15 12:28:54.444362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 263/509] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 12:28:54 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:28:54.615882 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:54.616417 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:54.623093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.623575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.624016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.624705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.625212 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.625642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.647952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lazy-loading 'flavor' on Instance uuid 602fceb0-200b-49d0-8c6f-28a5a36a8497 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:28:54.856671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-73cbb675-4e12-4255-9ec1-009c922ded12 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/action" status: 202 len: 0 microversion: 2.20 time: 0.244600 Sep 15 12:28:54.857302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 247/510] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 12:28:54 2022] POST /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:28:54.866516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:54.867409 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:54.874234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.874794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.875450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:54.876243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:54.876876 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:54.877318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:55.139616 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:55.147765 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:55.149261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:55.151000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4ba84b6a-c7e0-493c-a86c-5838316eee88 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.288781 Sep 15 12:28:55.151564 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 264/511] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:54 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:55.629962 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-7ea0f619-8275-4de1-ae25-2355b7778825 req-852407c2-3a98-4f52-a59c-5c98c60a06ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03869400-86b1-4b64-9251-a4545e0ff757", "tag": "56455d96-1ad4-4de2-9be8-e8dcd1602622"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:28:55.641034 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-7ea0f619-8275-4de1-ae25-2355b7778825 req-852407c2-3a98-4f52-a59c-5c98c60a06ed service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:55.641500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-7ea0f619-8275-4de1-ae25-2355b7778825 req-852407c2-3a98-4f52-a59c-5c98c60a06ed service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:55.642109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-7ea0f619-8275-4de1-ae25-2355b7778825 req-852407c2-3a98-4f52-a59c-5c98c60a06ed service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:55.652999 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-7ea0f619-8275-4de1-ae25-2355b7778825 req-852407c2-3a98-4f52-a59c-5c98c60a06ed service nova] Creating event network-changed:56455d96-1ad4-4de2-9be8-e8dcd1602622 for instance 03869400-86b1-4b64-9251-a4545e0ff757 on hv-cinder-85083 Sep 15 12:28:55.657889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-7ea0f619-8275-4de1-ae25-2355b7778825 req-852407c2-3a98-4f52-a59c-5c98c60a06ed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032821 Sep 15 12:28:55.658555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 248/512] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:28:56.177585 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:56.178290 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:56.185498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:56.185983 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:56.186415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:56.187174 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:56.187616 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:56.188031 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:56.324501 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:56.333304 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:56.334755 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:56.335925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-952bc377-297e-4d71-a43f-dc02c4700b50 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.162929 Sep 15 12:28:56.336710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 265/513] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:56 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:57.362813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:57.363423 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:57.370162 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:57.370616 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:57.371051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:57.371729 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:57.372175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:57.372591 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:57.504836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:57.513151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:57.514576 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:57.515740 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0da748c2-2646-4156-b8d0-5732c03cccdf tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.157964 Sep 15 12:28:57.516295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 249/514] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:57 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:58.541383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:58.541988 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:58.548643 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:58.549146 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:58.549575 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:58.550250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:58.550703 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:58.551112 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:58.680319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:58.688742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:58.690257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:58.691360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-899e9fae-95a2-4926-b509-83b7b122694c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.153939 Sep 15 12:28:58.691909 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 266/515] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:58 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:28:59.718214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:28:59.718862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:28:59.725348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:59.725829 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:59.726265 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:59.726952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:28:59.727407 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:28:59.727831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:28:59.864094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:59.872212 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:59.873679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:28:59.874834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bba5d9ef-c527-4861-a4ad-891a67df8a3d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.161455 Sep 15 12:28:59.875400 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 250/516] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:28:59 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:00.900776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:00.901403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:00.908583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:00.909097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:00.909532 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:00.910217 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:00.910669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:00.911092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:01.049116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:01.057109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:01.058532 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:01.059671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3778ec2f-e93f-4e1f-bf8f-83e8e3c33172 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.162913 Sep 15 12:29:01.060232 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 267/517] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:00 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:02.085604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:02.086218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:02.093033 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:02.093514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:02.093950 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:02.094638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:02.095089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:02.095515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:02.223752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:02.231737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:02.233789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:02.234939 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a4369055-ee29-423c-ad3b-4c4fcacb8e51 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.153477 Sep 15 12:29:02.235497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 251/518] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:02 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:03.260466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:03.261018 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:03.267600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:03.268086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:03.268522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:03.269265 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:03.269719 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:03.270142 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:03.405808 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:03.414314 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:03.415754 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:03.416990 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-022e8309-4a5b-4148-b252-11cffc84c58b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.160395 Sep 15 12:29:03.417562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 268/519] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:03 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:04.443464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:04.444071 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:04.450620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:04.451100 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:04.451533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:04.452915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:04.453369 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:04.453791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:04.471868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:04.598863 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:04.607371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:04.609136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:04.610313 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9b4be974-720e-490d-acff-f0e99d82319d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.170838 Sep 15 12:29:04.610868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 252/520] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:04 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:05.638713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:05.639341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:05.646468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:05.646950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:05.647382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:05.648067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:05.648524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:05.648995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:05.774977 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:05.783635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:05.785119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:05.786274 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-20367abd-8f4e-4984-9758-d1917a1e4de1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.151471 Sep 15 12:29:05.786841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 269/521] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:05 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:06.813755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:06.814397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:06.821833 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:06.822318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:06.822755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:06.823440 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:06.823888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:06.824307 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:06.953690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:06.962170 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:06.963618 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:06.965077 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f5f60307-122d-48a5-8d1a-8d15d94b803c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.156949 Sep 15 12:29:06.965638 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 253/522] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:06 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:07.989878 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:07.990491 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:07.997598 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:07.998084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:07.998516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:07.999197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:07.999646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:08.000068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:08.124569 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:08.132599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:08.134060 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:08.135206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-adcfa3b6-eadb-493c-8640-09aa90c315fb tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.149247 Sep 15 12:29:08.135767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 270/523] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:07 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:09.161547 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:09.162072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:09.168378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:09.168879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:09.169310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:09.169985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:09.170430 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:09.170843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:09.350817 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:09.358906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:09.360389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:09.361574 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-da4f296f-2e28-45d8-a782-995b17c1fdf5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.204122 Sep 15 12:29:09.362134 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 254/524] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:09 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:09.894775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:09.895281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:09.901148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:09.901622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:09.902053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:09.902729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:09.903178 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:09.903596 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:09.982908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'services' on Instance uuid ec9877ba-00fe-4496-89ec-e9b98befa363 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:29:10.053435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a93a7a39-4b27-4a96-9e7a-6242f6c8e19a tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments/74879c55-a06d-4398-89d3-9abeccf4a6b0" status: 202 len: 0 microversion: 2.1 time: 0.163141 Sep 15 12:29:10.054090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 271/525] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:29:09 2022] DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments/74879c55-a06d-4398-89d3-9abeccf4a6b0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:29:10.062393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:10.065249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:10.067094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:10.072203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:10.072682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:10.073138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:10.073823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:10.074271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:10.074717 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:10.104717 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c7084d72-3ace-4a34-ab32-c884db009cd1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046089 Sep 15 12:29:10.105256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 255/526] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:10 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:10.387552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:10.388158 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:10.394507 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:10.394981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:10.395412 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:10.396090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:10.396536 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:10.397033 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:10.524354 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:10.532874 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:10.534298 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:10.535457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5975767e-9360-409b-ae77-2047878b9092 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.152258 Sep 15 12:29:10.536017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 272/527] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:10 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:11.117627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:11.119744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:11.126580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.127050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.127478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.128154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.128631 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.129080 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.157357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6c50b8e4-4b81-47fa-9df3-2b74ce3f6cc0 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043781 Sep 15 12:29:11.157898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 256/528] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:11 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:29:11.235214 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:11.235723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:11.242130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.242614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.243051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.243739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.244191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.244616 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.270022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:29:11.346848 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0d30ce6e-836f-4609-b554-78d1c02a99e4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 204 len: 0 microversion: 2.1 time: 0.115254 Sep 15 12:29:11.347423 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 273/529] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:29:11 2022] DELETE /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:29:11.355647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:11.356257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:11.362922 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.363401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.363836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.364518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.364999 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.365420 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.492040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:11.499765 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c3d93333-b04d-4ae7-a48f-8f1b5077828e tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1689 microversion: 2.1 time: 0.147946 Sep 15 12:29:11.500337 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 257/530] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:11 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:11.561555 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:11.562253 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:11.568164 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.568647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.569120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.569803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:11.570253 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:11.570676 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:11.750114 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:11.758878 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:11.760312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:11.761493 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-97537be7-bc66-4c5c-b2a5-177ab405ae15 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.204185 Sep 15 12:29:11.762054 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 274/531] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:11 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:12.523103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:12.523753 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:12.530349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:12.530831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:12.531292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:12.532636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:12.533113 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:12.533541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:12.660160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:12.668031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f9d3375b-512e-4ff1-922f-1e1f8fef5535 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1689 microversion: 2.1 time: 0.148664 Sep 15 12:29:12.668649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 258/532] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:12 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:12.787600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:12.788170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:12.790603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:12.796545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:12.797059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:12.797505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:12.798758 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:12.799211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:12.799635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:12.814811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:12.936783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:12.948164 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:12.949632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:12.950792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cba862ea-437c-43d4-97a7-769b05d9da95 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.167160 Sep 15 12:29:12.951353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 275/533] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:12 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:13.692569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:13.693222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:13.699553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:13.700037 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:13.700476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:13.701225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:13.701678 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:13.702102 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:13.830027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:13.837742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1b7432e7-2f21-43ad-a5ab-b9be1eb7be9b tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1689 microversion: 2.1 time: 0.149736 Sep 15 12:29:13.838327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 259/534] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:13 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:13.976193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:13.976855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:13.983160 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:13.983636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:13.984066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:13.984746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:13.985224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:13.986264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:14.113904 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:14.121802 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:14.123237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:14.124395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-84ef7c3a-8c97-4b66-a437-0f392d325d85 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.152165 Sep 15 12:29:14.124978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 276/535] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:13 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:14.860840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:14.862217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:14.870108 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:14.870590 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:14.871022 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:14.871711 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:14.872288 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:14.872719 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:14.999620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:15.007383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c050500e-f8e4-43f4-ac6f-09452edd7a1f tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1689 microversion: 2.1 time: 0.150419 Sep 15 12:29:15.007957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 260/536] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:14 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:29:15.149991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:15.150596 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:15.157005 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:15.157476 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:15.157903 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:15.158576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:15.159102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:15.160559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:15.299163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:15.307645 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:15.309119 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:15.310298 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-601e4da6-f8e6-4d86-9d94-23239016d5be tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.164248 Sep 15 12:29:15.310869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 277/537] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:15 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:16.032692 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:16.033407 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:16.040257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:16.040744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:16.041205 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:16.041894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:16.042391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:16.042765 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:16.106457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:16.114810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8eee6ed5-0ef1-4349-b1d5-40f1534e4582 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 200 len: 1621 microversion: 2.1 time: 0.086026 Sep 15 12:29:16.115384 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 261/538] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:16 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 1621 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:16.180582 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-d4ba1932-5cdb-456f-8ed6-3ee69467c459 req-e318134c-caa6-4489-aa55-40a77e7b92c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9877ba-00fe-4496-89ec-e9b98befa363", "name": "network-vif-deleted", "tag": "3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:16.192730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-d4ba1932-5cdb-456f-8ed6-3ee69467c459 req-e318134c-caa6-4489-aa55-40a77e7b92c2 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:16.196203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-d4ba1932-5cdb-456f-8ed6-3ee69467c459 req-e318134c-caa6-4489-aa55-40a77e7b92c2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:16.198072 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-d4ba1932-5cdb-456f-8ed6-3ee69467c459 req-e318134c-caa6-4489-aa55-40a77e7b92c2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:16.210086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-d4ba1932-5cdb-456f-8ed6-3ee69467c459 req-e318134c-caa6-4489-aa55-40a77e7b92c2 service nova] Creating event network-vif-deleted:3f7bd403-b01d-4f2b-8d37-d2e2d09a2ca3 for instance ec9877ba-00fe-4496-89ec-e9b98befa363 on hv-cinder-85083 Sep 15 12:29:16.215638 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-d4ba1932-5cdb-456f-8ed6-3ee69467c459 req-e318134c-caa6-4489-aa55-40a77e7b92c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038723 Sep 15 12:29:16.216557 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 278/539] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:16.337903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:16.338526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:16.345357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:16.346213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:16.347346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:16.348258 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:16.348958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:16.349711 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:16.501607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:16.511390 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:16.512696 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:16.514103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a0e93696-2477-4dd9-a75f-db78b15de8e5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1746 microversion: 2.20 time: 0.180709 Sep 15 12:29:16.530174 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 262/540] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:16 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1746 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:17.139056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:17.139759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: ec9877ba-00fe-4496-89ec-e9b98befa363] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:17.146153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:17.146639 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:17.147081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:17.147775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:17.148220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:17.148882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:17.162774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] HTTP exception thrown: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 could not be found. Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Request method failure captured: Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 HTTP/1.1 Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxnB7wsCgruitXr_kJPgwhJtMaLy8atHs9pEDm71ipisUq8tht_i3pDfoIWi9GgGVnStKpeQ_I-l8Ny-Y1lJx_w7YV9xJZF3obfue8Dg2QT-VGJ1mko7WEr41DbLwHOuxNnP2JfLJNlddSyFX3y2XpPKwgIwHgREGbs49h_B4r2VeNM Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:29:17.164413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22801aa5908b4b098931d2588433e9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22801aa5908b4b098931d2588433e9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 20ca976222454c6c898d0e4b170b41fc Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 could not be found. Sep 15 12:29:17.165798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'ec9877ba-00fe-4496-89ec-e9b98befa363'} Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 could not be found. Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:29:17.166526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 could not be found. Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 could not be found. Sep 15 12:29:17.167745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:29:17.170095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Returning 404 to user: Instance ec9877ba-00fe-4496-89ec-e9b98befa363 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:29:17.170095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d590ae12-e556-4a31-a185-6dee5a6df301 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363" status: 404 len: 111 microversion: 2.1 time: 0.031233 Sep 15 12:29:17.170095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 279/541] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:17 2022] GET /compute/v2.1/servers/ec9877ba-00fe-4496-89ec-e9b98befa363 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:29:17.174616 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9a80afc3-2cee-4005-83cd-420f3001f810 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '.version_select at 0x7ff0d0450e50>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:17.195181 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9a80afc3-2cee-4005-83cd-420f3001f810 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865722295" status: 202 len: 0 microversion: 2.1 time: 0.024308 Sep 15 12:29:17.203561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 263/542] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 15 12:29:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865722295 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:29:17.542251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:17.542863 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:17.549261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:17.550252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:17.550686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:17.551365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:17.551809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:17.552232 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:17.765751 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:17.799125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:17.802634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:17.804021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-932bca63-93b2-476a-a60e-071b5cdf650c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1746 microversion: 2.20 time: 0.265623 Sep 15 12:29:17.805458 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 280/543] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:17 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1746 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:18.830370 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:18.832438 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:18.840176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:18.840670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:18.841259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:18.842125 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:18.842588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:18.843018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:18.988052 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:18.996787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:18.998264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:18.999483 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-cdf93d0b-6528-47a2-9e76-20c1112a1b75 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.173126 Sep 15 12:29:19.000041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 264/544] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:18 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:19.805001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-3abb3df0-e464-42eb-96e3-69e1a6e63473 req-3f3b8746-dadc-4bcc-a219-7e2af4593817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "name": "network-vif-plugged", "status": "completed", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:19.820143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-3abb3df0-e464-42eb-96e3-69e1a6e63473 req-3f3b8746-dadc-4bcc-a219-7e2af4593817 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:19.821013 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-3abb3df0-e464-42eb-96e3-69e1a6e63473 req-3f3b8746-dadc-4bcc-a219-7e2af4593817 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:19.821695 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-3abb3df0-e464-42eb-96e3-69e1a6e63473 req-3f3b8746-dadc-4bcc-a219-7e2af4593817 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:19.834554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-3abb3df0-e464-42eb-96e3-69e1a6e63473 req-3f3b8746-dadc-4bcc-a219-7e2af4593817 service nova] Creating event network-vif-plugged:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:29:19.842140 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-3abb3df0-e464-42eb-96e3-69e1a6e63473 req-3f3b8746-dadc-4bcc-a219-7e2af4593817 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040822 Sep 15 12:29:19.843417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 281/545] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:20.025796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:20.027073 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:20.033847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:20.034510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:20.035095 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:20.035961 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:20.036586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:20.037051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:20.179010 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:20.192849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:20.194893 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:20.196305 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-41f4051d-cf19-4773-b2d2-4a90e3fc8c06 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.174519 Sep 15 12:29:20.216261 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 265/546] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:20 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:20.225946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:20.227421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:20.235301 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:20.235805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:20.236311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:20.237787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:20.238464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:20.238964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:20.267892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:29:20.375883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f99d979a-08b9-447e-91fc-d4a9bc4de6f4 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 204 len: 0 microversion: 2.1 time: 0.155156 Sep 15 12:29:20.376984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 282/547] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:29:20 2022] DELETE /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:29:20.385728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:20.386350 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:20.392906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:20.393717 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:20.394672 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:20.395392 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:20.395848 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:20.396273 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:20.571030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:20.586238 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b5c2095d-6c95-44b0-bab8-62c07d909528 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1508 microversion: 2.1 time: 0.204420 Sep 15 12:29:20.587120 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 266/548] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:20 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:21.224579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:21.225403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:21.233243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:21.233646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:21.234221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:21.234928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:21.235503 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:21.236106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:21.400253 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:21.409821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:21.411287 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:21.412518 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-258d37b4-0054-4f61-aab2-d1d4693c432a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.192797 Sep 15 12:29:21.413143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 283/549] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:21 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:21.611173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:21.613164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:21.622767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:21.623348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:21.623881 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:21.624653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:21.625201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:21.625871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:21.765652 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:21.777015 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f93bd634-84eb-4fa3-b7bd-58d115309533 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1508 microversion: 2.1 time: 0.169545 Sep 15 12:29:21.777607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 267/550] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:21 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:22.439133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:22.440545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:22.448502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:22.449126 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:22.449478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:22.450153 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:22.450629 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:22.451063 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:22.604694 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:22.616092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:22.617744 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:22.618929 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-368091fe-6c84-4c63-af6c-4150dc612675 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.183635 Sep 15 12:29:22.619492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 284/551] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:22 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:22.801266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:22.803688 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:22.810378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:22.811086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:22.811687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:22.812553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:22.813036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:22.813463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:22.969750 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:22.979522 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-97152225-e6c7-4cd1-816e-b20db2d47710 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1508 microversion: 2.1 time: 0.183224 Sep 15 12:29:22.980406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 268/552] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:22 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:23.541646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-62af3724-e9db-4d67-9af0-03cc79b6a810 req-703f43dd-5ef3-4959-ab62-ff76a236856f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57deea25-f70f-4879-aa0d-f5d8cd294e53", "name": "network-vif-deleted", "tag": "cae77bb3-253f-485f-9be4-52543bc8042a"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:23.560708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-62af3724-e9db-4d67-9af0-03cc79b6a810 req-703f43dd-5ef3-4959-ab62-ff76a236856f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:23.561752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-62af3724-e9db-4d67-9af0-03cc79b6a810 req-703f43dd-5ef3-4959-ab62-ff76a236856f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:23.562467 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-62af3724-e9db-4d67-9af0-03cc79b6a810 req-703f43dd-5ef3-4959-ab62-ff76a236856f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:23.580976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-62af3724-e9db-4d67-9af0-03cc79b6a810 req-703f43dd-5ef3-4959-ab62-ff76a236856f service nova] Creating event network-vif-deleted:cae77bb3-253f-485f-9be4-52543bc8042a for instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 on hv-cinder-85083 Sep 15 12:29:23.587764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-62af3724-e9db-4d67-9af0-03cc79b6a810 req-703f43dd-5ef3-4959-ab62-ff76a236856f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054292 Sep 15 12:29:23.589697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 285/553] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:23.645906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:23.647155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:23.659115 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:23.659873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:23.660307 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:23.661224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:23.661828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:23.662408 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:23.833473 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:23.843506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:23.845312 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:23.848259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ac912c8a-e3fb-4a0f-a03b-28ef21be438d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.204817 Sep 15 12:29:23.849703 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 269/554] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:23 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:24.002892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:24.005791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:24.013947 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.015735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.016419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:24.017601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.020480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.021821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:24.060213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.060997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.061439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:24.062129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'fault' on Instance uuid 57deea25-f70f-4879-aa0d-f5d8cd294e53 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:29:24.091520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:24.092388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:24.098892 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.100078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.100864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:24.101966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.102630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.103283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:24.118241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:24.126946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d353990f-02ed-46f4-ba61-082712717c18 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 200 len: 1311 microversion: 2.1 time: 0.128227 Sep 15 12:29:24.128154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 286/555] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:23 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:24.146191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=100 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:24.152628 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-07f931df-7177-4952-92d1-596e3995884c tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/ips" status: 200 len: 146 microversion: 2.1 time: 0.139121 Sep 15 12:29:24.172967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 270/556] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:29:24 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/ips => generated 146 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:29:24.946682 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:24.948010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:24.957809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.958556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.959157 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:24.960636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:24.961266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:24.961857 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.106983 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:25.117448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:25.118868 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:25.120256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8fd6a0be-3924-485e-90f8-f4bccda2d30e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.249541 Sep 15 12:29:25.120999 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 287/557] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:24 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:25.151256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:25.152500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 57deea25-f70f-4879-aa0d-f5d8cd294e53] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:25.162430 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.163225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.163658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.164551 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.165193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.165642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.183361 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] HTTP exception thrown: Instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 could not be found. Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Request method failure captured: Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 HTTP/1.1 Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxnB7wsCgruitXr_kJPgwhJtMaLy8atHs9pEDm71ipisUq8tht_i3pDfoIWi9GgGVnStKpeQ_I-l8Ny-Y1lJx_w7YV9xJZF3obfue8Dg2QT-VGJ1mko7WEr41DbLwHOuxNnP2JfLJNlddSyFX3y2XpPKwgIwHgREGbs49h_B4r2VeNM Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:29:25.185414 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22801aa5908b4b098931d2588433e9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22801aa5908b4b098931d2588433e9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 20ca976222454c6c898d0e4b170b41fc Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 could not be found. Sep 15 12:29:25.186960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '57deea25-f70f-4879-aa0d-f5d8cd294e53'} Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 could not be found. Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:29:25.187808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 could not be found. Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 could not be found. Sep 15 12:29:25.189070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:25.191776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Returning 404 to user: Instance 57deea25-f70f-4879-aa0d-f5d8cd294e53 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:29:25.192812 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-421d6119-7661-4daf-81d3-7c8f9d6a38b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53" status: 404 len: 111 microversion: 2.1 time: 0.045407 Sep 15 12:29:25.193876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 271/558] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:25 2022] GET /compute/v2.1/servers/57deea25-f70f-4879-aa0d-f5d8cd294e53 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:29:25.202780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:25.203377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:25.211858 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.212354 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.212815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.213783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.214234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.214652 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.244085 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:29:25.334095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-544e929e-9690-405a-a07b-46cadc5ecaa1 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 204 len: 0 microversion: 2.1 time: 0.135277 Sep 15 12:29:25.335380 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 288/559] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:29:25 2022] DELETE /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:29:25.345171 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:25.345790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:25.355814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.356594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.357063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.357804 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.358262 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.358788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.505166 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:25.515839 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f4e29f35-5d8a-433b-b167-e9b302b17d63 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.175586 Sep 15 12:29:25.516712 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 272/560] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:25 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:29:25.569677 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc4996a8-f3eb-481a-913c-1587f445fe7d"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:25.572468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:25.578900 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.579529 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.579979 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:25.581648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:25.581792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:25.582196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:26.147723 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:26.148367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:26.154810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:26.155466 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:26.155781 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:26.156451 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:26.156972 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:26.157361 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:26.305745 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:26.314507 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:26.317518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:26.319149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fb83abe9-f74c-444e-952a-0c2f6630e07d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.175987 Sep 15 12:29:26.320920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 273/561] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:26 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:26.542130 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:26.542660 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:26.548669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:26.549738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:26.550179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:26.550868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:26.551353 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:26.551779 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:26.705669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:26.714026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0ecf8172-8337-4fa0-a68b-4f3945a5344d tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.176395 Sep 15 12:29:26.728602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 274/562] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:26 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:27.346675 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:27.347357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:27.354563 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:27.355438 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:27.356107 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:27.357070 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:27.357533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:27.357964 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:27.507689 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:27.519626 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:27.521466 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:27.523404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-69bb2aa3-a6c8-48ba-a0bd-4dd1382e01a9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.180072 Sep 15 12:29:27.523981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 275/563] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:27 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:29:27.738936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:27.739661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:27.748496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:27.749005 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:27.749443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:27.750133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:27.750578 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:27.750995 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:27.884474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:27.892380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-429840f1-1472-425e-aceb-73b9e6838a24 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.157914 Sep 15 12:29:27.893691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 276/564] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:27 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:28.557018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:28.557490 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:28.565175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:28.565675 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:28.566110 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:28.566802 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:28.569776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:28.570209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:28.709088 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:28.719699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:28.721507 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:28.722657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5ae444d3-13c3-4544-ad36-91cbd8f1846b tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1741 microversion: 2.20 time: 0.170064 Sep 15 12:29:28.723219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 277/565] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:28 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:29:28.849737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:28.859676 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-34b70b9b-3dca-40de-acf4-bb85f4d2538e tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.294301 Sep 15 12:29:28.860283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 289/566] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:29:25 2022] POST /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments => generated 194 bytes in 3296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:28.915476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:28.916084 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:28.922082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:28.922559 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:28.922990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:28.923665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:28.924107 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:28.924544 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:29.067758 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:29.075523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bc3e10e7-21d3-498a-9b3a-ba450a2facb2 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1521 microversion: 2.1 time: 0.163875 Sep 15 12:29:29.076114 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 278/567] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:28 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:29.749181 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:29.749877 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:29.759530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:29.760859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:29.761504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:29.762210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:29.762663 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:29.763088 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:29.825018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-c20baa07-81cf-4ef0-a97a-ff1a331c8da5 req-99030d07-82da-40a0-8a21-dd4a5544e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549690bd-637f-4b47-a149-1ccc7f45ec42", "name": "network-vif-deleted", "tag": "7fcd7e64-3ffd-4be7-bb28-45dbf4a74121"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:29.838878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c20baa07-81cf-4ef0-a97a-ff1a331c8da5 req-99030d07-82da-40a0-8a21-dd4a5544e465 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:29.839628 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c20baa07-81cf-4ef0-a97a-ff1a331c8da5 req-99030d07-82da-40a0-8a21-dd4a5544e465 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:29.840255 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c20baa07-81cf-4ef0-a97a-ff1a331c8da5 req-99030d07-82da-40a0-8a21-dd4a5544e465 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:29.853635 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-c20baa07-81cf-4ef0-a97a-ff1a331c8da5 req-99030d07-82da-40a0-8a21-dd4a5544e465 service nova] Creating event network-vif-deleted:7fcd7e64-3ffd-4be7-bb28-45dbf4a74121 for instance 549690bd-637f-4b47-a149-1ccc7f45ec42 on hv-cinder-85083 Sep 15 12:29:29.859911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-c20baa07-81cf-4ef0-a97a-ff1a331c8da5 req-99030d07-82da-40a0-8a21-dd4a5544e465 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038769 Sep 15 12:29:29.860526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 279/568] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:29.913325 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:29.921827 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:29.923270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:29.925044 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e0901f9a-95f3-41f3-9ccf-1fe70f95ae71 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1723 microversion: 2.20 time: 0.181254 Sep 15 12:29:29.925637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 290/569] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:29 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:30.100036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:30.101035 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:30.107659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:30.108157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:30.108594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:30.109336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:30.109787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:30.110235 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:30.144154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:30.144564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:30.145024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:30.145478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'fault' on Instance uuid 549690bd-637f-4b47-a149-1ccc7f45ec42 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:29:30.192168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:30.200112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-08026e7a-5846-42a0-8cf1-7329411805b6 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1311 microversion: 2.1 time: 0.104255 Sep 15 12:29:30.200691 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 280/570] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:30 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:30.951422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:30.952023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:30.958698 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:30.959176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:30.959604 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:30.960287 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:30.960731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:30.961176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:31.089222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:31.097761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:31.099183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:31.100331 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-848d1fdc-5e75-4be7-8100-357cbd2ea849 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1723 microversion: 2.20 time: 0.152801 Sep 15 12:29:31.100980 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 291/571] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:30 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:31.223627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:31.224708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:31.230760 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:31.231236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:31.231668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:31.232352 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:31.232832 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:31.233256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:31.262879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:31.263344 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:31.263777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:31.264411 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lazy-loading 'fault' on Instance uuid 549690bd-637f-4b47-a149-1ccc7f45ec42 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:29:31.305847 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ca976222454c6c898d0e4b170b41fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22801aa5908b4b098931d2588433e9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:31.313666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6c256bcf-60fa-4c86-8f77-b73bb1087b38 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 200 len: 1311 microversion: 2.1 time: 0.094149 Sep 15 12:29:31.314256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 281/572] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:31 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:29:31.801573 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-8b4aaf1b-454f-467e-a14c-887e2d1c17e4 req-7267b39b-6410-440e-9de2-d1e2f50f68b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "name": "network-vif-unplugged", "status": "completed", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:31.813384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-8b4aaf1b-454f-467e-a14c-887e2d1c17e4 req-7267b39b-6410-440e-9de2-d1e2f50f68b6 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:31.813844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-8b4aaf1b-454f-467e-a14c-887e2d1c17e4 req-7267b39b-6410-440e-9de2-d1e2f50f68b6 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:31.814269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-8b4aaf1b-454f-467e-a14c-887e2d1c17e4 req-7267b39b-6410-440e-9de2-d1e2f50f68b6 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:31.825984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-8b4aaf1b-454f-467e-a14c-887e2d1c17e4 req-7267b39b-6410-440e-9de2-d1e2f50f68b6 service nova] Creating event network-vif-unplugged:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:29:31.830659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-8b4aaf1b-454f-467e-a14c-887e2d1c17e4 req-7267b39b-6410-440e-9de2-d1e2f50f68b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033556 Sep 15 12:29:31.831427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 292/573] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:29:32.125424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:32.126044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:32.132503 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.133022 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.133468 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.134155 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.134608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.135034 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.266033 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:32.274126 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:32.275551 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:32.276698 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c73edf30-3310-4826-92d0-6c1088be4519 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1726 microversion: 2.20 time: 0.155232 Sep 15 12:29:32.277276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 282/574] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:32 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:32.303885 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fb6a5a1-9700-4baf-9f15-8b8b721c2e59"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:32.306303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:32.312576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.313084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.313515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.314200 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.314644 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.315091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.344899 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:32.345845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] [instance: 549690bd-637f-4b47-a149-1ccc7f45ec42] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:32.353606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.354081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.354594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.355341 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.355862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.356195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.371824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] HTTP exception thrown: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 could not be found. Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Request method failure captured: Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 HTTP/1.1 Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxnB7wsCgruitXr_kJPgwhJtMaLy8atHs9pEDm71ipisUq8tht_i3pDfoIWi9GgGVnStKpeQ_I-l8Ny-Y1lJx_w7YV9xJZF3obfue8Dg2QT-VGJ1mko7WEr41DbLwHOuxNnP2JfLJNlddSyFX3y2XpPKwgIwHgREGbs49h_B4r2VeNM Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:29:32.373510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22801aa5908b4b098931d2588433e9db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22801aa5908b4b098931d2588433e9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22801aa5908b4b098931d2588433e9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 22801aa5908b4b098931d2588433e9db Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282333844 Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 20ca976222454c6c898d0e4b170b41fc Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282333844-project Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 could not be found. Sep 15 12:29:32.374858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '549690bd-637f-4b47-a149-1ccc7f45ec42'} Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 could not be found. Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:29:32.375637 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 could not be found. Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 could not be found. Sep 15 12:29:32.377761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:29:32.381041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] Returning 404 to user: Instance 549690bd-637f-4b47-a149-1ccc7f45ec42 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:29:32.381041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-708b0f60-0dc5-448f-88f2-5b23547e8783 tempest-ServerRescueNegativeTestJSON-282333844 tempest-ServerRescueNegativeTestJSON-282333844-project] 10.222.0.15 "GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42" status: 404 len: 111 microversion: 2.1 time: 0.033797 Sep 15 12:29:32.381041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 283/575] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:29:32 2022] GET /compute/v2.1/servers/549690bd-637f-4b47-a149-1ccc7f45ec42 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 12:29:32.620072 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5030ae22-8509-463a-964d-c1d80208760c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321891 Sep 15 12:29:32.621007 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 293/576] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Sep 15 12:29:32 2022] POST /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 12:29:32.753790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:32.754292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:32.760380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.760921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.761360 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:32.762049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:32.762501 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:32.762925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:33.004933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-794d85d0-f4a6-43db-9567-d8908f0a585e tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-volume_attachments/7fb6a5a1-9700-4baf-9f15-8b8b721c2e59" status: 202 len: 0 microversion: 2.20 time: 0.255132 Sep 15 12:29:33.005525 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 284/577] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Sep 15 12:29:32 2022] DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-volume_attachments/7fb6a5a1-9700-4baf-9f15-8b8b721c2e59 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:29:33.067243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:33.067837 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:33.076746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:33.077258 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:33.077688 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:33.078382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:33.078830 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:33.079251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:33.125820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120437) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 12:29:33.202335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-55e46c76-4e14-4a1c-92d3-4c149de049c1 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "POST /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/action" status: 202 len: 0 microversion: 2.20 time: 0.139394 Sep 15 12:29:33.203427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 294/578] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 12:29:33 2022] POST /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:29:33.211619 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:33.212601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:33.220017 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:33.220595 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:33.221489 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:33.222748 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:33.223231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:33.223909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:33.515017 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:33.523924 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:33.525511 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:33.526680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7bb1a3a0-83a6-456a-8396-6ea80ecb613c tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1674 microversion: 2.20 time: 0.319142 Sep 15 12:29:33.527425 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 285/579] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:33 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1674 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:29:34.553389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:34.554162 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:34.561281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:34.561899 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:34.562433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:34.563221 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:34.564058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:34.564539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:34.791108 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:34.801015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:34.802537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:34.803747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-06d871c2-5f67-400a-977c-1f53fbeb600f tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.254849 Sep 15 12:29:34.804339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 295/580] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:34 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:35.829774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:35.830530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:35.837797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:35.838707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:35.839559 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:35.840332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:35.843510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:35.843510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:35.845989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:35.999416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:36.008559 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:36.010027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:36.011394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fedd4ec5-4363-4ac9-8821-f458fd52f409 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.185808 Sep 15 12:29:36.011949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 286/581] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:35 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:36.455701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:36.458234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:36.479461 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:36.480306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:36.482297 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:36.483976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:36.485738 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:36.486532 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:36.531823 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6989edf1-88d7-4701-8e27-5a1122325aac tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080427 Sep 15 12:29:36.540374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 296/582] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:36 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:29:36.548846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:36.549436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:36.566057 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:36.566690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:36.567195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:36.568011 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:36.568831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:36.569605 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:36.640132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-718bf25d-e75a-419a-affc-7b9ea860d25a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/dc4996a8-f3eb-481a-913c-1587f445fe7d" status: 200 len: 194 microversion: 2.1 time: 0.098729 Sep 15 12:29:36.647335 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 287/583] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 15 12:29:36 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/dc4996a8-f3eb-481a-913c-1587f445fe7d => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:37.040133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:37.041013 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:37.050490 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:37.054388 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:37.055042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:37.057887 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:37.058504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:37.059092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:37.311093 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:37.333588 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:37.335886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:37.337653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9668eea4-79fa-43fa-b3df-e19621ceb6d2 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.302556 Sep 15 12:29:37.339933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 297/584] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:37 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:38.216331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13d48bc9-20d0-44b3-8d11-b5d40bfaef9c"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:38.218948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:38.227586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:38.228332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:38.229199 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:38.230542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:38.231273 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:38.231859 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:38.369622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:38.370336 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:38.377687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:38.379034 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:38.379634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:38.380659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:38.382184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:38.383028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:38.555438 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:38.563923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:38.566154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:38.567346 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fab7e896-2e52-400e-960a-39ec679d7de8 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.201769 Sep 15 12:29:38.567990 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 298/585] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:38 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:39.623665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:39.624258 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:39.631102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:39.631585 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:39.632013 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:39.632696 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:39.633198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:39.633815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:39.658819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3ee87b87-73a4-47e5-9ca7-6420504c264b tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/ips" status: 200 len: 151 microversion: 2.1 time: 0.297093 Sep 15 12:29:39.666574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 299/586] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:29:39 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/ips => generated 151 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:39.672869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:39.673721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:39.680316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:39.680842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:39.681492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:39.682383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:39.682997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:39.683580 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:39.847735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:39.858600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:39.860302 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:39.861795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a9fbc845-0246-46f9-80dd-12617f48b7c4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.194026 Sep 15 12:29:39.864384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 300/587] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:39 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:40.891356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:40.892090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:40.899150 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:40.899635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:40.900069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:40.900779 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:40.901268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:40.901690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:41.043909 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:41.052350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:41.056443 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:41.057741 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f5c58b67-fc85-474a-a584-292034e46ca9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.170439 Sep 15 12:29:41.058853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 301/588] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:40 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:29:41.109216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b62bfb8-22f8-46b8-a332-37b8677114bb"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:41.112002 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:41.118568 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:41.119048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:41.119472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:41.120156 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:41.120599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:41.121038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:45.567871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=88,nova_cell1:UPDATE=7 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:45.588722 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-58631547-a26f-49a2-8b64-babd2d57f330 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "POST /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.376804 Sep 15 12:29:45.589478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a8611c83-7f5d-4b66-a8e3-5bb91e7a3ed5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "POST /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.483489 Sep 15 12:29:45.589710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 288/589] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:29:38 2022] POST /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments => generated 194 bytes in 7379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:45.596814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 302/590] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:29:41 2022] POST /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 194 bytes in 4486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:45.611574 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:45.612974 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:45.615435 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:45.621911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:45.622403 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:45.622828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:45.623709 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:45.624324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:45.624772 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:45.767436 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:45.776189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:45.777678 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:45.778839 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5d3cfb13-4d44-41fd-b129-33de42498a34 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.188046 Sep 15 12:29:45.779406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 289/591] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:45 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:46.804883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:46.805601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:46.808666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:46.813958 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:46.814432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:46.814916 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:46.815594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:46.816040 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:46.816474 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:46.948279 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:46.956338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:46.957883 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:46.959047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f6f695e9-7cf5-415a-be69-7437ab81e5e9 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.158488 Sep 15 12:29:46.959600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 303/592] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:46 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:47.984660 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:47.985533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:47.994219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:47.994753 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:47.995397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:47.996283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:47.996907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:47.997480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:48.169005 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:48.177657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:48.179099 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:48.180388 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bcaf12f4-862d-46a5-827c-c8187248e500 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.199787 Sep 15 12:29:48.181000 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 290/593] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:47 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:49.206208 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:49.206819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:49.213480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:49.213839 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:49.214283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:49.214943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:49.215389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:49.215807 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:49.351235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:49.360037 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:49.366463 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:49.367776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-15def68e-a990-4cb1-a120-ea313b2ed25d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.165509 Sep 15 12:29:49.368428 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 304/594] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:49 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:49.985421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-a8f6d91b-cdd6-47fb-8449-52302332a996 req-a5b6b075-2bd6-45a8-ae4c-9b2e311f77fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "name": "network-vif-plugged", "status": "completed", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:29:49.996818 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-a8f6d91b-cdd6-47fb-8449-52302332a996 req-a5b6b075-2bd6-45a8-ae4c-9b2e311f77fc service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:49.997680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-a8f6d91b-cdd6-47fb-8449-52302332a996 req-a5b6b075-2bd6-45a8-ae4c-9b2e311f77fc service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:49.998185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-a8f6d91b-cdd6-47fb-8449-52302332a996 req-a5b6b075-2bd6-45a8-ae4c-9b2e311f77fc service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:50.011129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-a8f6d91b-cdd6-47fb-8449-52302332a996 req-a5b6b075-2bd6-45a8-ae4c-9b2e311f77fc service nova] Creating event network-vif-plugged:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:29:50.017063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-a8f6d91b-cdd6-47fb-8449-52302332a996 req-a5b6b075-2bd6-45a8-ae4c-9b2e311f77fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035801 Sep 15 12:29:50.019132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 291/595] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:50.394210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:50.395007 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:50.401948 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:50.402433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:50.402869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:50.403787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:50.404435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:50.404914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:50.547632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:50.556369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:50.557865 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:50.559027 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1303a602-ce2f-4423-bbef-d14122dd8aa4 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.169774 Sep 15 12:29:50.559713 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 305/596] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:50 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:51.594705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:51.595491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:51.602025 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:51.602708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:51.603209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:51.603908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:51.604366 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:51.604813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:51.755758 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:51.765167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:51.766762 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:51.768078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-90d30a85-1408-4bb9-8f3f-7c6fbf107cc5 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1732 microversion: 2.20 time: 0.177988 Sep 15 12:29:51.768804 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 292/597] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:51 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:52.793476 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:52.794212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:52.802047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:52.802876 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:52.803644 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:52.805220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:52.806027 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:52.806811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:52.960401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:52.969334 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:52.971405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:29:52.972606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8cba640b-0214-42f0-ae76-6402982b8170 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1719 microversion: 2.20 time: 0.183002 Sep 15 12:29:52.973213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 306/598] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:29:52 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:29:53.339895 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:53.340470 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:53.347286 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:53.347776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:53.348219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:53.348950 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:53.349405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:53.349830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:53.438530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lazy-loading 'services' on Instance uuid 03869400-86b1-4b64-9251-a4545e0ff757 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:29:53.516370 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a4466b70-7532-47b0-8972-9ce7a5cb712d tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments/8b62bfb8-22f8-46b8-a332-37b8677114bb" status: 202 len: 0 microversion: 2.1 time: 0.180561 Sep 15 12:29:53.518282 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 293/599] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:29:53 2022] DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments/8b62bfb8-22f8-46b8-a332-37b8677114bb => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:29:53.527357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:53.529880 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:53.537006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:53.537631 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:53.538183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:53.538975 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:53.540443 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:53.540969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:53.576648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-29370e62-a369-4458-8fa9-858b1a3ad803 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053668 Sep 15 12:29:53.577247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 307/600] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:53 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:54.591099 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:54.593477 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:54.600303 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:54.600790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:54.601224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:54.601905 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:54.602347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:54.602765 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:54.633253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c4a3328d-50f6-42d4-9dd6-0e3d6dc7cf5a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Sep 15 12:29:54.633894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 294/601] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:54 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:55.645630 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:55.647844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:55.654297 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:55.654773 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:55.655328 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:55.655871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:55.656325 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:55.657053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:55.688310 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d4b004dc-c301-4749-9c24-d02460bc7aa1 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046560 Sep 15 12:29:55.688889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 308/602] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:55 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:56.701349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:56.703564 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:56.709965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:56.710439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:56.710868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:56.711542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:56.711985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:56.712402 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:56.741873 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0685105f-4e47-4e10-a2a9-64b83c451279 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Sep 15 12:29:56.742422 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 295/603] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:56 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:57.756455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:57.759210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:57.766761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:57.767810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:57.768267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:57.768978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:57.769428 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:57.769850 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:57.800797 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2ceb92cb-2b13-45cc-9e9a-ae978e1e48b6 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050105 Sep 15 12:29:57.801394 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 309/604] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:57 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:58.813226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:58.815373 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:58.821845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:58.822306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:58.822738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:58.823418 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:58.823864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:58.824282 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:58.854082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-63b9122b-b5be-496e-8c6a-a950005a2eb5 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Sep 15 12:29:58.854653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 296/605] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:58 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:29:59.547186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:59.549690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:59.556258 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.556743 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.557208 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.557896 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.558346 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.558771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.592820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a8516f5f-a1af-4283-ad2e-78f77b7669d5 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049952 Sep 15 12:29:59.593401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 310/606] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:59 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:59.734357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:59.734853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:59.741597 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.742071 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.742561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.743220 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.743646 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.744066 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.772096 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a69a4cbc-e155-45a3-a73c-bc7f23df112d tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/dc4996a8-f3eb-481a-913c-1587f445fe7d" status: 200 len: 194 microversion: 2.1 time: 0.041775 Sep 15 12:29:59.772669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 297/607] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 15 12:29:59 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/dc4996a8-f3eb-481a-913c-1587f445fe7d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:29:59.783597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:59.784092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:59.789959 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.790441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.790871 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.791556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.792006 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.792430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.867987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:29:59.871011 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:29:59.876023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lazy-loading 'services' on Instance uuid 94e31c4e-af5d-494f-a84b-d6be20a1bb86 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:29:59.879174 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.879848 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.880433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.881325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:29:59.881771 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:29:59.882190 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:29:59.922989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-213ac280-c2f5-4704-a9a9-1c58a1acea27 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059821 Sep 15 12:29:59.924323 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 298/608] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:29:59 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:29:59.963197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-547e980f-c320-474b-80e0-b1a344aea685 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/dc4996a8-f3eb-481a-913c-1587f445fe7d" status: 202 len: 0 microversion: 2.1 time: 0.183565 Sep 15 12:29:59.964130 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 311/609] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:29:59 2022] DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/dc4996a8-f3eb-481a-913c-1587f445fe7d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:30:00.005708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:00.006286 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:00.013476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:00.014406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:00.014857 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:00.015554 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:00.016043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:00.016474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:00.042437 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Going to try to terminate instance {{(pid=120436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:30:00.092048 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:00.118676 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5e0f2fd8-db8c-456e-91cc-171a46e7c68f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 204 len: 0 microversion: 2.1 time: 0.117262 Sep 15 12:30:00.119251 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 299/610] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:29:59 2022] DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:30:00.128577 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:00.129307 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:00.135379 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:00.135857 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:00.136297 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:00.137016 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:00.137464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:00.137886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:00.269585 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:00.277168 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6a84a21c-ec1a-406d-9207-12fedee8e20e tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1682 microversion: 2.1 time: 0.153375 Sep 15 12:30:00.277739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 312/611] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:00 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:01.301688 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:01.302314 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:01.308837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:01.309323 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:01.309761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:01.310449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:01.310902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:01.311326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:01.441507 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:01.449086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7142ea56-0409-4bc6-a68b-b181255dba91 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1682 microversion: 2.1 time: 0.151752 Sep 15 12:30:01.449658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 300/612] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:01 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:02.474582 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:02.475905 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:02.483962 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:02.484193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:02.484997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:02.485742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:02.486197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:02.486623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:02.699844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:02.708124 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ff9fffed-a19c-4974-ac9a-fa4026eabc53 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1682 microversion: 2.1 time: 0.238484 Sep 15 12:30:02.708803 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 313/613] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:02 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:03.251811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:03.252317 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:03.258550 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.259296 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.259952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.260938 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.261645 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.262498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.319832 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b03dc39c-717f-4bd9-9fbc-9ae7c9f205fb tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/13d48bc9-20d0-44b3-8d11-b5d40bfaef9c" status: 200 len: 194 microversion: 2.1 time: 0.071982 Sep 15 12:30:03.321942 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 314/614] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 15 12:30:03 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/13d48bc9-20d0-44b3-8d11-b5d40bfaef9c => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:03.343560 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:03.344084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:03.366199 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.366710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.367158 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.369805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.371950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.374711 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.462167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-d25bbe0d-d3bd-4eae-b057-0a708bd63f1d req-700ae86e-c1a9-4973-8e76-7a1e1aa9b422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03869400-86b1-4b64-9251-a4545e0ff757", "name": "network-vif-deleted", "tag": "56455d96-1ad4-4de2-9be8-e8dcd1602622"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:03.478814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d25bbe0d-d3bd-4eae-b057-0a708bd63f1d req-700ae86e-c1a9-4973-8e76-7a1e1aa9b422 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.479795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d25bbe0d-d3bd-4eae-b057-0a708bd63f1d req-700ae86e-c1a9-4973-8e76-7a1e1aa9b422 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.480466 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d25bbe0d-d3bd-4eae-b057-0a708bd63f1d req-700ae86e-c1a9-4973-8e76-7a1e1aa9b422 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.493965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-d25bbe0d-d3bd-4eae-b057-0a708bd63f1d req-700ae86e-c1a9-4973-8e76-7a1e1aa9b422 service nova] Creating event network-vif-deleted:56455d96-1ad4-4de2-9be8-e8dcd1602622 for instance 03869400-86b1-4b64-9251-a4545e0ff757 on hv-cinder-85083 Sep 15 12:30:03.499116 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-d25bbe0d-d3bd-4eae-b057-0a708bd63f1d req-700ae86e-c1a9-4973-8e76-7a1e1aa9b422 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422153 Sep 15 12:30:03.499738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 301/615] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:30:03.529069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lazy-loading 'services' on Instance uuid 94e31c4e-af5d-494f-a84b-d6be20a1bb86 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:03.611745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4d21f150-7ce3-4556-a722-99d3ff456bfe tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/13d48bc9-20d0-44b3-8d11-b5d40bfaef9c" status: 202 len: 0 microversion: 2.1 time: 0.282794 Sep 15 12:30:03.615786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 315/616] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:30:03 2022] DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments/13d48bc9-20d0-44b3-8d11-b5d40bfaef9c => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:30:03.733808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:03.734519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:03.741315 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.742109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.742718 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.743693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.744342 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.744961 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.781649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:03.782430 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:03.783065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:03.783743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lazy-loading 'fault' on Instance uuid 03869400-86b1-4b64-9251-a4545e0ff757 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:03.832533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ead4be9666942f2b81cbb0f9ab69325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a670696e63446e4bf597c40c6e72490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:03.842349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b4af309a-02a9-42b7-8db3-b84fe5998d2f tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 200 len: 1330 microversion: 2.1 time: 0.112676 Sep 15 12:30:03.853480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 302/617] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:03 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 1330 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:04.799994 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:04.803098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:04.809543 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:04.810055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:04.810488 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:04.811189 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:04.811643 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:04.812069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:04.841799 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-28920a11-432d-4c19-a115-60b052afbf52 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047120 Sep 15 12:30:04.842367 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 316/618] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:30:04 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:30:04.866902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:04.867596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:04.874540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:04.876076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:04.876942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:04.877858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:04.878390 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:04.878888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:04.893311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 HTTP/1.1 Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:04.909560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:04.911283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '03869400-86b1-4b64-9251-a4545e0ff757'} Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:04.912622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:04.914189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:04.916603 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:04.916603 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f504359e-043e-4024-b51b-22e144f9f5ed tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 404 len: 111 microversion: 2.1 time: 0.048169 Sep 15 12:30:04.916603 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 303/619] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:04 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:04.921651 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e71524ff-dd5f-4acc-9dd7-562ac5ba533a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '.version_select at 0x7ff0d04d8280>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:04.942675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e71524ff-dd5f-4acc-9dd7-562ac5ba533a tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-303028707" status: 202 len: 0 microversion: 2.1 time: 0.025748 Sep 15 12:30:04.943247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 317/620] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 12:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-303028707 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:30:04.972298 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:04.974792 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:04.983937 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:04.984495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:04.985017 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:04.986611 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:04.987261 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:04.987897 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:05.018833 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4f77214d-f4df-4058-9454-55cde5db5f7a tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051466 Sep 15 12:30:05.025897 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 304/621] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:30:04 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:30:05.089865 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:05.090364 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:05.098181 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:05.098801 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:05.099350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:05.100189 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:05.100643 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:05.101835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:05.134475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:30:05.136626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:05.230279 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f7717bff-caec-4513-9b6f-608ff42a603b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 204 len: 0 microversion: 2.1 time: 0.144200 Sep 15 12:30:05.231184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 318/622] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:05 2022] DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:30:05.239746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:05.240658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:05.246592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:05.247330 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:05.247977 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:05.248885 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:05.249543 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:05.250161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:05.518739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:05.528592 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-80fa3338-77cf-46ec-9c2c-572317f8840b tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1672 microversion: 2.1 time: 0.292593 Sep 15 12:30:05.529263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 305/623] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:05 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:06.552866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:06.553647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:06.559994 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:06.560471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:06.560947 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:06.561623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:06.562065 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:06.562481 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:06.700224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:06.708551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c4e582a9-b9a2-445b-a421-a97ae12a0195 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1672 microversion: 2.1 time: 0.160811 Sep 15 12:30:06.709152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 319/624] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:06 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:07.041439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:07.041946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:07.048905 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:07.049389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:07.049829 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:07.050515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:07.050971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:07.051395 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:07.066936 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 HTTP/1.1 Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:07.068456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.070021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '03869400-86b1-4b64-9251-a4545e0ff757'} Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:07.071003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.072202 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.073679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:07.073679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-deada791-ee25-4819-a470-5e16967055bc tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 404 len: 111 microversion: 2.1 time: 0.032233 Sep 15 12:30:07.073679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 306/625] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:07 2022] DELETE /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:07.078225 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:07.078843 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 03869400-86b1-4b64-9251-a4545e0ff757] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:07.084775 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:07.085264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:07.085703 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:07.086384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:07.086835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:07.087530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:07.100448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 HTTP/1.1 Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:07.102084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.103609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '03869400-86b1-4b64-9251-a4545e0ff757'} Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:07.104455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. Sep 15 12:30:07.105968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:07.107641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 03869400-86b1-4b64-9251-a4545e0ff757 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:07.107641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d3b21d0e-52af-4927-bad1-b1a8a23fe8a4 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757" status: 404 len: 111 microversion: 2.1 time: 0.029019 Sep 15 12:30:07.107641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 320/626] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:07 2022] GET /compute/v2.1/servers/03869400-86b1-4b64-9251-a4545e0ff757 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:07.668100 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1368489742", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "networks": [{"uuid": "012212cf-2811-4109-8c21-3f3712895c40"}]}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:07.729261 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] validate_networks() for [('012212cf-2811-4109-8c21-3f3712895c40', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:30:07.731814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:07.732429 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:07.739066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:07.739556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:07.739989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:07.740684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:07.741160 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:07.741584 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:07.822279 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89cc4de76c6a4305af9a9506840e13f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2780dab9a5d40739fc9adc9a6ce35a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:07.832544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c64d98d8-1f05-4b51-87af-9c0c36db5934 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 200 len: 1605 microversion: 2.1 time: 0.104532 Sep 15 12:30:07.833237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 321/627] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:07 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 1605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:30:07.995646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-fbbe68bc-47f9-482b-9eda-1df8edc58a90 req-39a57e21-4042-4966-b908-edbafc94efc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e31c4e-af5d-494f-a84b-d6be20a1bb86", "name": "network-vif-deleted", "tag": "36d013e2-79cd-4a77-80e6-66f26edcdd2b"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:08.009074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-fbbe68bc-47f9-482b-9eda-1df8edc58a90 req-39a57e21-4042-4966-b908-edbafc94efc9 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.009989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-fbbe68bc-47f9-482b-9eda-1df8edc58a90 req-39a57e21-4042-4966-b908-edbafc94efc9 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.010642 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-fbbe68bc-47f9-482b-9eda-1df8edc58a90 req-39a57e21-4042-4966-b908-edbafc94efc9 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.022669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-fbbe68bc-47f9-482b-9eda-1df8edc58a90 req-39a57e21-4042-4966-b908-edbafc94efc9 service nova] Creating event network-vif-deleted:36d013e2-79cd-4a77-80e6-66f26edcdd2b for instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 on hv-cinder-85083 Sep 15 12:30:08.027661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-fbbe68bc-47f9-482b-9eda-1df8edc58a90 req-39a57e21-4042-4966-b908-edbafc94efc9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035590 Sep 15 12:30:08.029033 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 322/628] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:08.222777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:30:08.223725 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:30:08.224431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:30:08.229272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:30:08.229707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:30:08.241555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.242050 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.242536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.243270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.243910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.244636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.266277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.267651 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:08.273416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Getting quotas for project 092e830b85d3479a952d2e4ada193ab3. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:30:08.276938 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.277424 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.277828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Getting quotas for user 0818d1847d5e42b6a942557f95b09d05 and project 092e830b85d3479a952d2e4ada193ab3. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:30:08.277944 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.278545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.278990 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.279666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.289608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:30:08.291923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:30:08.295962 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f HTTP/1.1 Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:08.299437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.301038 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'e0bbaa77-aba7-4c9b-9777-91f17808f77f'} Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:08.305202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.306435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.307614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:08.307614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6012e474-1f6a-49fe-8125-8bb82ef76aaf tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 404 len: 111 microversion: 2.1 time: 0.049945 Sep 15 12:30:08.307614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 323/629] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:08 2022] DELETE /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:08.309155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.309764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: e0bbaa77-aba7-4c9b-9777-91f17808f77f] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:08.317324 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.317809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.318244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.319055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.319888 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.320321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.334659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f HTTP/1.1 Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:08.336107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.337941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'e0bbaa77-aba7-4c9b-9777-91f17808f77f'} Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:08.339373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. Sep 15 12:30:08.340882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.342395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance e0bbaa77-aba7-4c9b-9777-91f17808f77f could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:08.342395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-dd767b29-fa16-465b-9672-e73a2ab2a2ef tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f" status: 404 len: 111 microversion: 2.1 time: 0.032246 Sep 15 12:30:08.342395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 324/630] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:08 2022] GET /compute/v2.1/servers/e0bbaa77-aba7-4c9b-9777-91f17808f77f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 12:30:08.346129 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.346619 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:08.348136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d5574896-5e75-4f7a-af5c-0166b73692d3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683812 Sep 15 12:30:08.349021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 307/631] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:30:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:30:08.352731 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.353241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.353673 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.354404 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.355127 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.355552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.361118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-24a88e56-318a-409b-8067-ffcfcf8010be tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.361118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-24a88e56-318a-409b-8067-ffcfcf8010be tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:08.369762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 HTTP/1.1 Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:08.371567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.373144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '25a55838-1ab5-494c-89fb-1781130c69c6'} Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:08.374100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.375595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.378670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:08.378670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-825d7297-77c7-4150-8535-72defd9e4791 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 404 len: 111 microversion: 2.1 time: 0.030636 Sep 15 12:30:08.378670 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 325/632] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:08 2022] DELETE /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 12:30:08.382108 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.382748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 25a55838-1ab5-494c-89fb-1781130c69c6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:08.389603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.390091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.391203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.391936 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.392407 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.392849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.411850 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 HTTP/1.1 Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:08.413686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.415247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '25a55838-1ab5-494c-89fb-1781130c69c6'} Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:08.416318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. Sep 15 12:30:08.417735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.418986 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 25a55838-1ab5-494c-89fb-1781130c69c6 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:08.418986 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-62b03cda-0c3a-4456-819c-6a29ad10e9ad tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6" status: 404 len: 111 microversion: 2.1 time: 0.039514 Sep 15 12:30:08.419311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 326/633] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:08 2022] GET /compute/v2.1/servers/25a55838-1ab5-494c-89fb-1781130c69c6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:08.431720 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-24a88e56-318a-409b-8067-ffcfcf8010be tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:08.440377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-24a88e56-318a-409b-8067-ffcfcf8010be tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1214 microversion: 2.1 time: 0.084316 Sep 15 12:30:08.453148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 308/634] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:08 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:08.855436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.856010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:08.863100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.863609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.864035 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.864725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:08.865194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:08.865613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:08.880088 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] HTTP exception thrown: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Request method failure captured: Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 HTTP/1.1 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3tV42vMnwxSRYlw5nf-HNo_-qCe_-uSIXG9LW3ZYfjrgZXd-lL7nrNtOYzkELNatgFpVfaKZB1fZwaH5EkNt3w_5SqZ3wRuqQG7gE9dLwHgabgheaSO0lGim3rHT1lAVbawxCnSh9R1KUXJ4y6jHDxbKlPwTZSNanjol__zijEj4 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:08.881757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 89cc4de76c6a4305af9a9506840e13f6 Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:08.883138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '94e31c4e-af5d-494f-a84b-d6be20a1bb86'} Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:08.883859 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:08.885515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:08.886967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Returning 404 to user: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:08.886967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f774ecfc-d615-4f9d-8000-457849749051 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 404 len: 111 microversion: 2.1 time: 0.031686 Sep 15 12:30:08.886967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 327/635] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:08 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:08.894357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c6bed6e9-4225-452f-bbaa-2e798b96d804 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '.version_select at 0x7ff0d09750d0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:08.915439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c6bed6e9-4225-452f-bbaa-2e798b96d804 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-285837333" status: 202 len: 0 microversion: 2.1 time: 0.026935 Sep 15 12:30:08.916337 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 309/636] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 12:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-285837333 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:30:09.463750 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:09.464356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:09.470727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:09.471407 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:09.472017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:09.472738 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:09.473197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:09.473792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:09.541700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:09.552737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-077d8bac-4157-4f5a-b75c-d5f16c7bb532 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1266 microversion: 2.1 time: 0.093117 Sep 15 12:30:09.553702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 328/637] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:09 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:09.600263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:09.600817 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:09.614111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:09.614593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:09.615270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:09.616098 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:09.616805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:09.617393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:09.639866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a HTTP/1.1 Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:09.644109 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.646040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '3545e504-2e9b-41e0-903c-f58ab4aa380a'} Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:09.646901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.648680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.650103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:09.650103 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2fa35174-e276-4ff3-986f-d5203dcfdc80 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 404 len: 111 microversion: 2.1 time: 0.052351 Sep 15 12:30:09.650392 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 310/638] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:09 2022] DELETE /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:09.658797 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:09.659591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] [instance: 3545e504-2e9b-41e0-903c-f58ab4aa380a] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:09.666702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:09.667692 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:09.668187 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:09.668931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:09.669439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:09.669864 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:09.685538 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] HTTP exception thrown: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Request method failure captured: Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a HTTP/1.1 Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl76R9m6bhBA4KYmrCYa9iTGG2Apx1bZMmZYyqYjDvwHNfOdCVVBfdYkikWglAOBCT4_ZrboCggCFEPRxECAMs7WnlHdz97A3k_t4nHeiQV_TQriIWtDso4AjnvwFXLtyofUo5hXoymXMGOZ5Qrn3rJ4Is8vh0g5xZQCEemj1XzQfc Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:09.687338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a670696e63446e4bf597c40c6e72490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a670696e63446e4bf597c40c6e72490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 7a670696e63446e4bf597c40c6e72490 Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-600701591 Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 4ead4be9666942f2b81cbb0f9ab69325 Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeNegativeTest-600701591-project Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.689551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '3545e504-2e9b-41e0-903c-f58ab4aa380a'} Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:09.690316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. Sep 15 12:30:09.691517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:09.692671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] Returning 404 to user: Instance 3545e504-2e9b-41e0-903c-f58ab4aa380a could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:09.692671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9cadc68a-8eb1-465c-97ab-847fddbd6501 tempest-AttachVolumeNegativeTest-600701591 tempest-AttachVolumeNegativeTest-600701591-project] 10.222.0.15 "GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a" status: 404 len: 111 microversion: 2.1 time: 0.034674 Sep 15 12:30:09.699456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 329/639] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:09 2022] GET /compute/v2.1/servers/3545e504-2e9b-41e0-903c-f58ab4aa380a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:10.585862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:10.586739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:10.594366 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:10.595144 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:10.595735 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:10.596631 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:10.597311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:10.597907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:10.915969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:10.924784 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f0488be3-34ec-42cc-9031-ff4e7aa7c620 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1314 microversion: 2.1 time: 0.342732 Sep 15 12:30:10.925478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 311/640] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:10 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:30:10.982892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-1f3939a8-30be-4bbf-982b-1f1d322c36cd req-1ace2615-e819-4c49-8ab6-ae7b281c44b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09cd678-3e61-4368-a490-a5f2e2a48594", "tag": "34096392-0ce6-42e9-8f15-c88e6885c394"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:10.998610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-1f3939a8-30be-4bbf-982b-1f1d322c36cd req-1ace2615-e819-4c49-8ab6-ae7b281c44b0 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:10.999275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-1f3939a8-30be-4bbf-982b-1f1d322c36cd req-1ace2615-e819-4c49-8ab6-ae7b281c44b0 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:11.000385 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-1f3939a8-30be-4bbf-982b-1f1d322c36cd req-1ace2615-e819-4c49-8ab6-ae7b281c44b0 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:11.015145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-1f3939a8-30be-4bbf-982b-1f1d322c36cd req-1ace2615-e819-4c49-8ab6-ae7b281c44b0 service nova] Creating event network-changed:34096392-0ce6-42e9-8f15-c88e6885c394 for instance b09cd678-3e61-4368-a490-a5f2e2a48594 on hv-cinder-85083 Sep 15 12:30:11.020849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-1f3939a8-30be-4bbf-982b-1f1d322c36cd req-1ace2615-e819-4c49-8ab6-ae7b281c44b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041480 Sep 15 12:30:11.021579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 330/641] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:11.930016 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:11.930661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:11.937663 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:11.938458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:11.939007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:11.940133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:11.940404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:11.948311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:11.949217 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:11.952411 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:11.960307 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:11.960993 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:11.962419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:11.963385 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:11.968772 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:11.969256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:11.975281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] HTTP exception thrown: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Request method failure captured: Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 HTTP/1.1 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl3tV42vMnwxSRYlw5nf-HNo_-qCe_-uSIXG9LW3ZYfjrgZXd-lL7nrNtOYzkELNatgFpVfaKZB1fZwaH5EkNt3w_5SqZ3wRuqQG7gE9dLwHgabgheaSO0lGim3rHT1lAVbawxCnSh9R1KUXJ4y6jHDxbKlPwTZSNanjol__zijEj4 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:11.980049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 89cc4de76c6a4305af9a9506840e13f6 Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:11.981380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '94e31c4e-af5d-494f-a84b-d6be20a1bb86'} Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:11.982089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:11.983259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:11.986613 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Returning 404 to user: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:11.987746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8863a8f9-73ff-47ec-9785-5e04d7050e53 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 404 len: 111 microversion: 2.1 time: 0.061888 Sep 15 12:30:11.991973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 312/642] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:11 2022] DELETE /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:11.997006 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:11.997929 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 94e31c4e-af5d-494f-a84b-d6be20a1bb86] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:12.004886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:12.005693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:12.006354 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:12.007400 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:12.008088 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:12.008737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:12.025143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] HTTP exception thrown: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Request method failure captured: Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 HTTP/1.1 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl3tV42vMnwxSRYlw5nf-HNo_-qCe_-uSIXG9LW3ZYfjrgZXd-lL7nrNtOYzkELNatgFpVfaKZB1fZwaH5EkNt3w_5SqZ3wRuqQG7gE9dLwHgabgheaSO0lGim3rHT1lAVbawxCnSh9R1KUXJ4y6jHDxbKlPwTZSNanjol__zijEj4 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:12.026942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 89cc4de76c6a4305af9a9506840e13f6 Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:12.028494 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '94e31c4e-af5d-494f-a84b-d6be20a1bb86'} Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:12.029416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. Sep 15 12:30:12.030925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:12.032670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Returning 404 to user: Instance 94e31c4e-af5d-494f-a84b-d6be20a1bb86 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:12.034055 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2587cca6-14af-4abd-a60b-f0b85d000402 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86" status: 404 len: 111 microversion: 2.1 time: 0.040764 Sep 15 12:30:12.034810 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 313/643] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:11 2022] GET /compute/v2.1/servers/94e31c4e-af5d-494f-a84b-d6be20a1bb86 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:12.169056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:12.191382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-37cfd336-71fd-4009-b3e8-3ce0407daba9 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1314 microversion: 2.1 time: 0.247218 Sep 15 12:30:12.191966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 331/644] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:11 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:30:13.215249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:13.216875 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:13.224649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:13.225433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:13.226051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:13.226908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:13.227505 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:13.229152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:13.229780 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:13.230355 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:13.234100 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:13.234770 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:13.235961 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:13.236674 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:13.237149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:13.237759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:13.252335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] HTTP exception thrown: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Request method failure captured: Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 HTTP/1.1 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3tV42vMnwxSRYlw5nf-HNo_-qCe_-uSIXG9LW3ZYfjrgZXd-lL7nrNtOYzkELNatgFpVfaKZB1fZwaH5EkNt3w_5SqZ3wRuqQG7gE9dLwHgabgheaSO0lGim3rHT1lAVbawxCnSh9R1KUXJ4y6jHDxbKlPwTZSNanjol__zijEj4 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:13.254842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 89cc4de76c6a4305af9a9506840e13f6 Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.256413 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '4481d43d-2a44-4a3c-b167-2b99e195a673'} Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:13.257303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.258761 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.261935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Returning 404 to user: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:13.264212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4c948855-c939-48a0-9220-cec13e15ffa4 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 404 len: 111 microversion: 2.1 time: 0.044506 Sep 15 12:30:13.265403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 332/645] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:13 2022] DELETE /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:13.275547 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:13.276369 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] [instance: 4481d43d-2a44-4a3c-b167-2b99e195a673] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:13.287203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:13.287940 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:13.288537 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:13.289482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:13.290090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:13.290697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:13.318680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] HTTP exception thrown: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Request method failure captured: Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 HTTP/1.1 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3tV42vMnwxSRYlw5nf-HNo_-qCe_-uSIXG9LW3ZYfjrgZXd-lL7nrNtOYzkELNatgFpVfaKZB1fZwaH5EkNt3w_5SqZ3wRuqQG7gE9dLwHgabgheaSO0lGim3rHT1lAVbawxCnSh9R1KUXJ4y6jHDxbKlPwTZSNanjol__zijEj4 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:13.320261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2780dab9a5d40739fc9adc9a6ce35a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: d2780dab9a5d40739fc9adc9a6ce35a1 Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741736354 Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 89cc4de76c6a4305af9a9506840e13f6 Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeTestJSON-741736354-project Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.321650 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '4481d43d-2a44-4a3c-b167-2b99e195a673'} Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:13.322415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. Sep 15 12:30:13.324190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:13.325466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] Returning 404 to user: Instance 4481d43d-2a44-4a3c-b167-2b99e195a673 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:13.325466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0d96d2c4-67b8-44ef-a885-76f8f6634e21 tempest-AttachVolumeTestJSON-741736354 tempest-AttachVolumeTestJSON-741736354-project] 10.222.0.15 "GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673" status: 404 len: 111 microversion: 2.1 time: 0.051082 Sep 15 12:30:13.325466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 333/646] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:13 2022] GET /compute/v2.1/servers/4481d43d-2a44-4a3c-b167-2b99e195a673 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:13.456640 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:13.473491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6db8c1c2-9ce6-4436-9416-1406b321e6b6 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1314 microversion: 2.1 time: 0.262651 Sep 15 12:30:13.474618 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 314/647] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:13 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:14.499500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:14.501042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:14.507952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:14.508714 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:14.509326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:14.510202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:14.510809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:14.511379 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:14.669982 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:14.680155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-10f49055-526a-4407-891c-c0518471bf0a tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1314 microversion: 2.1 time: 0.186758 Sep 15 12:30:14.680710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 334/648] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:14 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:15.295874 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-05c542c0-acec-47e6-ad2a-0da43062f60f tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Action: 'create', calling method: .version_select at 0x7ff0d04509d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-267927331", "metadata": {"Type": "work"}}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:15.631572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-05c542c0-acec-47e6-ad2a-0da43062f60f tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.453061 Sep 15 12:30:15.640654 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 315/649] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 12:30:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 463 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 12:30:15.645905 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b2aadea6-ba76-4c82-b669-e06c2d9a2eca tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Calling method '.version_select at 0x7ff0d04c8dc0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:15.708152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:15.709426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:15.711786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:15.717223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b2aadea6-ba76-4c82-b669-e06c2d9a2eca tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b" status: 200 len: 352 microversion: 2.1 time: 0.075500 Sep 15 12:30:15.718303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 335/650] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:30:15 2022] GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:15.723927 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:15.724631 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:15.725269 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:15.725984 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:15.726433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:15.727036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:15.956457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:15.965632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c78133c1-eb2e-487c-bf64-ebb42723ffb2 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1314 microversion: 2.1 time: 0.261866 Sep 15 12:30:15.966304 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 316/651] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:15 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:16.239575 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-5cfb9354-9e66-483f-b12f-7abbb4fc07b9 req-40ea8a9a-b980-4958-87bb-a365d2768130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09cd678-3e61-4368-a490-a5f2e2a48594", "name": "network-vif-plugged", "status": "completed", "tag": "34096392-0ce6-42e9-8f15-c88e6885c394"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:16.254612 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5cfb9354-9e66-483f-b12f-7abbb4fc07b9 req-40ea8a9a-b980-4958-87bb-a365d2768130 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:16.255169 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5cfb9354-9e66-483f-b12f-7abbb4fc07b9 req-40ea8a9a-b980-4958-87bb-a365d2768130 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:16.257079 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-5cfb9354-9e66-483f-b12f-7abbb4fc07b9 req-40ea8a9a-b980-4958-87bb-a365d2768130 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:16.272018 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-5cfb9354-9e66-483f-b12f-7abbb4fc07b9 req-40ea8a9a-b980-4958-87bb-a365d2768130 service nova] Creating event network-vif-plugged:34096392-0ce6-42e9-8f15-c88e6885c394 for instance b09cd678-3e61-4368-a490-a5f2e2a48594 on hv-cinder-85083 Sep 15 12:30:16.277080 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-5cfb9354-9e66-483f-b12f-7abbb4fc07b9 req-40ea8a9a-b980-4958-87bb-a365d2768130 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115244 Sep 15 12:30:16.277680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 336/652] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:16.732147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ac7bc590-1996-4f96-82ea-38e49b65d251 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Calling method '.version_select at 0x7ff0d0476af0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:16.787600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ac7bc590-1996-4f96-82ea-38e49b65d251 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b" status: 200 len: 353 microversion: 2.1 time: 0.059211 Sep 15 12:30:16.788439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 317/653] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:30:16 2022] GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:16.802106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a418795e-16d8-482c-b2d8-de2fb2bde3b2 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Calling method '.version_select at 0x7ff0d0730040>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:16.854235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a418795e-16d8-482c-b2d8-de2fb2bde3b2 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b" status: 200 len: 353 microversion: 2.1 time: 0.056685 Sep 15 12:30:16.854922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 337/654] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:30:16 2022] GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:30:16.873745 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9e04ff64-64b8-4af4-94f4-b8656d236e42 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Calling method '.version_select at 0x7ff0d047a1f0>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:16.946822 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9e04ff64-64b8-4af4-94f4-b8656d236e42 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b" status: 202 len: 0 microversion: 2.1 time: 0.077819 Sep 15 12:30:16.947393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 318/655] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 12:30:16 2022] DELETE /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:30:16.956496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-46bd7afe-1c8d-47cd-93d9-92dcf2239e74 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Calling method '.version_select at 0x7ff0d04159d0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:16.993787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:16.994505 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:17.009031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:17.009538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:17.009987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:17.010921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:17.011394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:17.012324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:17.024252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-46bd7afe-1c8d-47cd-93d9-92dcf2239e74 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b" status: 200 len: 352 microversion: 2.1 time: 0.071902 Sep 15 12:30:17.033808 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 338/656] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:30:16 2022] GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:17.214129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:17.224432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-80c6e09b-5334-427d-9abf-9836b86a8cc3 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1314 microversion: 2.1 time: 0.234648 Sep 15 12:30:17.225826 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 319/657] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:16 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:18.039205 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-feb29b9b-fc87-4519-b683-dcc4d9a6b370 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Calling method '.version_select at 0x7ff0d04803a0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:18.070073 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-feb29b9b-fc87-4519-b683-dcc4d9a6b370 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] HTTP exception thrown: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-feb29b9b-fc87-4519-b683-dcc4d9a6b370 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Request method failure captured: Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b HTTP/1.1 Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxrXKf85rjS1aYJEkn7fWZj-RjnQeDy_otCShMoLCZ30Vxgx4dLaJ6n8pbi-WMdLhVelaQJ0eVGQW15H6-TDG1DVIk8rR5haJePDIS7uB2wrsaDp4zKmqQUKcbIWWBa1OCxl3gcQ05uG0LTptANT09BG8RzRzkyqKiBqDTFkgqrBSuo Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: dfa85af8efe5425d88c4cc99910d83f2 Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesGetTestJSON-1004598085 Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:18.072237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dfa85af8efe5425d88c4cc99910d83f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dfa85af8efe5425d88c4cc99910d83f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dfa85af8efe5425d88c4cc99910d83f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dfa85af8efe5425d88c4cc99910d83f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesGetTestJSON-1004598085 Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: dfa85af8efe5425d88c4cc99910d83f2 Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesGetTestJSON-1004598085 Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesGetTestJSON-1004598085-project Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 80dc3908a9044cccb7b07a3919d35d1e Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesGetTestJSON-1004598085-project Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '55e7142c-a91e-425a-9f90-bade93c3530b'} Sep 15 12:30:18.073737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. (HTTP 404) (Request-ID: req-11793699-266e-45a0-8124-d81f9d8a98ab) Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:18.074683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 12:30:18.075920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 12:30:18.077110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-feb29b9b-fc87-4519-b683-dcc4d9a6b370 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] Returning 404 to user: Volume 55e7142c-a91e-425a-9f90-bade93c3530b could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-feb29b9b-fc87-4519-b683-dcc4d9a6b370 tempest-VolumesGetTestJSON-1004598085 tempest-VolumesGetTestJSON-1004598085-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b" status: 404 len: 109 microversion: 2.1 time: 0.039031 Sep 15 12:30:18.078275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 339/658] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 12:30:18 2022] GET /compute/v2.1/os-volumes/55e7142c-a91e-425a-9f90-bade93c3530b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:18.247317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:18.247926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:18.254518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:18.256923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:18.257799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:18.258529 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:18.259457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:18.260250 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:18.260794 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:18.415401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:18.424353 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-83cde59c-2100-44aa-8d40-fafccade3e5c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1499 microversion: 2.1 time: 0.180850 Sep 15 12:30:18.424965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 320/659] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:18 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1499 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:18.944515 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:18.945733 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:18.961202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:18.963887 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:18.965699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:18.966188 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:18.967313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:18.967921 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:18.968477 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:19.012600 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:30:19.118665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-396322a3-5598-49c8-93cb-b3e0c7f5f0d5 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 204 len: 0 microversion: 2.1 time: 0.183883 Sep 15 12:30:19.119779 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 340/660] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:18 2022] DELETE /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:30:19.130977 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:19.131597 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:19.133793 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=8 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:19.141241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:19.141813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:19.142140 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:19.142821 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:19.143272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:19.143728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:19.339598 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:19.352139 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5b902b96-a3c2-43dc-b063-6854acf67edf tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1505 microversion: 2.1 time: 0.227657 Sep 15 12:30:19.354015 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 321/661] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:19 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:20.376900 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:20.377601 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:20.384067 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:20.386663 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:20.386663 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:20.387197 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:20.387666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:20.388092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:20.549590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:20.557586 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c44dfaeb-5004-4a22-8736-aeb91d7bb41d tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1505 microversion: 2.1 time: 0.184827 Sep 15 12:30:20.558177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 341/662] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:20 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:21.289092 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-d70b537f-8578-4d1d-924b-0dd8ecf5624d req-1f4a062c-aa98-42e1-9dcd-29027722ea9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09cd678-3e61-4368-a490-a5f2e2a48594", "name": "network-vif-deleted", "tag": "34096392-0ce6-42e9-8f15-c88e6885c394"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:21.300065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d70b537f-8578-4d1d-924b-0dd8ecf5624d req-1f4a062c-aa98-42e1-9dcd-29027722ea9e service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:21.300544 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d70b537f-8578-4d1d-924b-0dd8ecf5624d req-1f4a062c-aa98-42e1-9dcd-29027722ea9e service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:21.301008 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d70b537f-8578-4d1d-924b-0dd8ecf5624d req-1f4a062c-aa98-42e1-9dcd-29027722ea9e service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:21.312610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-d70b537f-8578-4d1d-924b-0dd8ecf5624d req-1f4a062c-aa98-42e1-9dcd-29027722ea9e service nova] Creating event network-vif-deleted:34096392-0ce6-42e9-8f15-c88e6885c394 for instance b09cd678-3e61-4368-a490-a5f2e2a48594 on hv-cinder-85083 Sep 15 12:30:21.317989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-d70b537f-8578-4d1d-924b-0dd8ecf5624d req-1f4a062c-aa98-42e1-9dcd-29027722ea9e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Sep 15 12:30:21.318584 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 322/663] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:21.584450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:21.585090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:21.591788 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:21.592266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:21.592696 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:21.593406 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:21.594410 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:21.594863 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:21.625240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:21.625715 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:21.626154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:21.626626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lazy-loading 'fault' on Instance uuid b09cd678-3e61-4368-a490-a5f2e2a48594 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:21.667969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:21.678876 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4df31e4a-d7d1-4910-b4cd-59f39505ac09 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1304 microversion: 2.1 time: 0.097899 Sep 15 12:30:21.679694 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 342/664] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:21 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:22.705304 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:22.706043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:22.713879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:22.714418 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:22.714854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:22.715549 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:22.716000 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:22.716426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:22.747931 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:22.748403 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:22.748876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:22.749314 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lazy-loading 'fault' on Instance uuid b09cd678-3e61-4368-a490-a5f2e2a48594 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:22.790279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:22.798205 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c92f058a-b87d-449a-8eda-054ea84176de tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1304 microversion: 2.1 time: 0.099739 Sep 15 12:30:22.798767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 323/665] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:22 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:23.821356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:23.821971 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:23.829805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:23.830288 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:23.830717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:23.831405 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:23.831852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:23.832269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:23.871345 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:23.871842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:23.872270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:23.872711 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lazy-loading 'fault' on Instance uuid b09cd678-3e61-4368-a490-a5f2e2a48594 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:23.876047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:23.918371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:23.926105 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b765bd0c-e9b4-4a4d-9f64-d579b744cdbd tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 200 len: 1304 microversion: 2.1 time: 0.108707 Sep 15 12:30:23.926662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 343/666] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:23 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:24.949030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:24.949642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: b09cd678-3e61-4368-a490-a5f2e2a48594] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:24.956320 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:24.956832 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:24.957268 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:24.957958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:24.958404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:24.959118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:24.974160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] HTTP exception thrown: Instance b09cd678-3e61-4368-a490-a5f2e2a48594 could not be found. Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Request method failure captured: Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 HTTP/1.1 Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxrOHwAwwXwLOtdbwWb0Qd1bA1kN4-DhkdNFIEMiI0RWvG2DviH7DsIP4cisgzC2uNKGmMfyD_emvOIyexXXFJIXgaKpgV3RiOt4FbBgXXBkMR0S6eHvYxdxi9JjnK5aShs9fKyANS2zzbaNL7ykD6qU3D1YPGZ_3KT3GQKD0X3FVGs Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 092e830b85d3479a952d2e4ada193ab3 Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-VolumesActionsTest-458328811 Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:24.975805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-VolumesActionsTest-458328811 Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 092e830b85d3479a952d2e4ada193ab3 Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-VolumesActionsTest-458328811 Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-VolumesActionsTest-458328811-project Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 0818d1847d5e42b6a942557f95b09d05 Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-VolumesActionsTest-458328811-project Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance b09cd678-3e61-4368-a490-a5f2e2a48594 could not be found. Sep 15 12:30:24.977443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'b09cd678-3e61-4368-a490-a5f2e2a48594'} Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09cd678-3e61-4368-a490-a5f2e2a48594 could not be found. Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:24.978918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09cd678-3e61-4368-a490-a5f2e2a48594 could not be found. Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09cd678-3e61-4368-a490-a5f2e2a48594 could not be found. Sep 15 12:30:24.980545 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:24.981730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Returning 404 to user: Instance b09cd678-3e61-4368-a490-a5f2e2a48594 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:24.981730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-13077205-b2bf-49a1-85d1-8aa97892a576 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594" status: 404 len: 111 microversion: 2.1 time: 0.032186 Sep 15 12:30:24.981730 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 324/667] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:24 2022] GET /compute/v2.1/servers/b09cd678-3e61-4368-a490-a5f2e2a48594 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:30:25.076241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1476198352", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "networks": [{"uuid": "012212cf-2811-4109-8c21-3f3712895c40"}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:25.130850 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] validate_networks() for [('012212cf-2811-4109-8c21-3f3712895c40', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:30:25.576637 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:30:25.576979 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:30:25.577455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:30:25.578387 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:30:25.578800 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:30:25.588117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:25.588672 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:25.589199 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:25.590116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:25.590573 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:25.591032 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:25.608747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Getting quotas for project 092e830b85d3479a952d2e4ada193ab3. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:30:25.612835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Getting quotas for user 0818d1847d5e42b6a942557f95b09d05 and project 092e830b85d3479a952d2e4ada193ab3. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:30:25.624191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:30:25.626699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:30:25.679021 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-47e2d925-f1de-4886-9f6d-45efcfdd3646 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607496 Sep 15 12:30:25.679822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 344/668] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:30:25.692032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e861f6b7-88c2-448a-b112-901fc08a9ffe tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:25.692930 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e861f6b7-88c2-448a-b112-901fc08a9ffe tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:25.752039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e861f6b7-88c2-448a-b112-901fc08a9ffe tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:25.760886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e861f6b7-88c2-448a-b112-901fc08a9ffe tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1214 microversion: 2.1 time: 0.073112 Sep 15 12:30:25.770542 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 325/669] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:25 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:26.785195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:26.786214 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:26.793921 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:26.794406 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:26.794837 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:26.795560 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:26.796011 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:26.796429 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:26.860960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:26.868539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a69cd4c7-b0ce-4d1b-ad7b-7ab3c767d569 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1218 microversion: 2.1 time: 0.088980 Sep 15 12:30:26.869141 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 345/670] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:26 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:27.891779 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:27.892389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:27.901711 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:27.902396 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:27.902985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:27.904332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:27.904799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:27.905264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:27.967081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:27.980000 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-38c33980-bc03-4216-aed9-ee5600baf3e7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1210 microversion: 2.1 time: 0.092252 Sep 15 12:30:27.980580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 326/671] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:27 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:29.003980 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:29.005257 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:29.011689 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:29.012310 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:29.012980 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:29.013897 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:29.014355 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:29.014797 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:29.173011 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:29.181830 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-796d751b-aa6a-4ea7-94b7-8aa2dc4b85a7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.181893 Sep 15 12:30:29.182433 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 346/672] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:28 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:29.772790 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-fdfb63bd-cc4b-4dfe-b51b-bbde0cbb83cf req-151dcba1-b4b4-45ba-91fc-d704804c528f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327b0a6c-be02-439a-91cb-a98b0c98bc66", "tag": "b86a7f2f-5559-4521-ad76-1d4958335a33"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:29.783019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-fdfb63bd-cc4b-4dfe-b51b-bbde0cbb83cf req-151dcba1-b4b4-45ba-91fc-d704804c528f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:29.783519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-fdfb63bd-cc4b-4dfe-b51b-bbde0cbb83cf req-151dcba1-b4b4-45ba-91fc-d704804c528f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:29.783943 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-fdfb63bd-cc4b-4dfe-b51b-bbde0cbb83cf req-151dcba1-b4b4-45ba-91fc-d704804c528f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:29.795291 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-fdfb63bd-cc4b-4dfe-b51b-bbde0cbb83cf req-151dcba1-b4b4-45ba-91fc-d704804c528f service nova] Creating event network-changed:b86a7f2f-5559-4521-ad76-1d4958335a33 for instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 on hv-cinder-85083 Sep 15 12:30:29.800735 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-fdfb63bd-cc4b-4dfe-b51b-bbde0cbb83cf req-151dcba1-b4b4-45ba-91fc-d704804c528f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Sep 15 12:30:29.801465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 327/673] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:30.210653 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:30.211752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:30.220078 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:30.220330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:30.220942 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:30.221752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:30.222210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:30.222634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:30.357259 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:30.366625 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-aa67143d-66f7-4048-ad94-9c40753deced tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.165465 Sep 15 12:30:30.367213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 347/674] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:30 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:31.391737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:31.392399 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:31.399508 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:31.399995 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:31.400431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:31.401157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:31.401613 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:31.402045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:31.406077 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:31.542127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:31.550465 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-53066a60-8713-4ade-ace1-9f9535fceb28 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.164012 Sep 15 12:30:31.551043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 328/675] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:31 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:30:32.573866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:32.575285 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:32.582546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:32.583215 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:32.583820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:32.584502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:32.584981 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:32.585604 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:32.717969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:32.725591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e6c43c85-9b1d-490c-8dd1-68e4d79ac451 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.155767 Sep 15 12:30:32.726156 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 348/676] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:32 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:33.749672 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:33.750846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:33.757108 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:33.757583 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:33.758009 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:33.758694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:33.770271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:33.770271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:33.779932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:33.782239 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:33.792192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:33.793242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:33.794888 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:33.795956 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:33.796917 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:33.797316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:33.842048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8635ec7e-b22f-4ee6-bf70-9d34db1c9e42 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066043 Sep 15 12:30:33.842638 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 349/677] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 12:30:33 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:30:33.903124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:33.912156 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f8d3f107-ccf6-486a-83b7-a5aab9e17d82 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.166508 Sep 15 12:30:33.913179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:33.913571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 329/678] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:33 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:33.914596 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:33.920791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:33.921593 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:33.921782 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:33.922711 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:33.923305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:33.923915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:33.950419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:30:34.041970 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b5db529c-afba-4635-a5ed-677e167fdb1d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 204 len: 0 microversion: 2.20 time: 0.129914 Sep 15 12:30:34.046163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 350/679] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 12:30:33 2022] DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 12:30:34.055890 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:34.056713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:34.066740 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:34.067831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:34.069036 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:34.069962 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:34.071263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:34.072483 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:34.211923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:34.220053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:34.222053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:34.223218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f8e83e72-51c7-4b2a-8ead-7e20b36d8ff6 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.176232 Sep 15 12:30:34.223786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 330/680] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:34 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:30:34.935836 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:34.936574 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:34.943136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:34.943756 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:34.944148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:34.944866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:34.945317 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:34.945762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:35.074136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:35.081682 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7c8d65ea-88e8-4074-a099-bf959ab38fec tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.150125 Sep 15 12:30:35.082238 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 351/681] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:34 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:35.249867 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:35.250416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:35.256784 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:35.257267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:35.257704 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:35.258389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:35.258842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:35.259264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:35.391409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:35.404974 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:35.406421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:35.407608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-036ae731-a768-4843-8cd6-e14ca411fd74 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1725 microversion: 2.20 time: 0.161763 Sep 15 12:30:35.408794 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 331/682] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:35 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:30:36.058179 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-6422d016-f181-4cb9-999f-f8fbe864a0e7 req-2a6dda69-40e3-4e04-a9fb-343343dd1e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327b0a6c-be02-439a-91cb-a98b0c98bc66", "name": "network-vif-plugged", "status": "completed", "tag": "b86a7f2f-5559-4521-ad76-1d4958335a33"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:36.073466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:36.074337 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:36.080673 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6422d016-f181-4cb9-999f-f8fbe864a0e7 req-2a6dda69-40e3-4e04-a9fb-343343dd1e80 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:36.081588 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6422d016-f181-4cb9-999f-f8fbe864a0e7 req-2a6dda69-40e3-4e04-a9fb-343343dd1e80 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:36.082216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6422d016-f181-4cb9-999f-f8fbe864a0e7 req-2a6dda69-40e3-4e04-a9fb-343343dd1e80 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:36.102913 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-6422d016-f181-4cb9-999f-f8fbe864a0e7 req-2a6dda69-40e3-4e04-a9fb-343343dd1e80 service nova] Creating event network-vif-plugged:b86a7f2f-5559-4521-ad76-1d4958335a33 for instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 on hv-cinder-85083 Sep 15 12:30:36.106112 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:36.106907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:36.108706 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-6422d016-f181-4cb9-999f-f8fbe864a0e7 req-2a6dda69-40e3-4e04-a9fb-343343dd1e80 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057401 Sep 15 12:30:36.109831 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 352/683] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:36.114908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:36.117457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:36.117946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:36.120136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:36.130504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:36.130997 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:36.131441 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:36.272865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:36.281793 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-61f2ebad-5d93-4baa-8c83-06d999e15787 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.179616 Sep 15 12:30:36.282382 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 332/684] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:36 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:36.434857 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:36.435619 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:36.444026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-35378ea9-4805-4107-be50-726424b1e54e req-8bcdc4dc-7f8e-47ef-8453-a3747709b35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602fceb0-200b-49d0-8c6f-28a5a36a8497", "name": "network-vif-deleted", "tag": "b91b9ec8-e9af-4ccd-9400-a8594f083719"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:36.452081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:36.452579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:36.457962 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-35378ea9-4805-4107-be50-726424b1e54e req-8bcdc4dc-7f8e-47ef-8453-a3747709b35e service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:36.458440 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-35378ea9-4805-4107-be50-726424b1e54e req-8bcdc4dc-7f8e-47ef-8453-a3747709b35e service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:36.458869 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-35378ea9-4805-4107-be50-726424b1e54e req-8bcdc4dc-7f8e-47ef-8453-a3747709b35e service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:36.461582 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:36.462233 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:36.462721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:36.463144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:36.480176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-35378ea9-4805-4107-be50-726424b1e54e req-8bcdc4dc-7f8e-47ef-8453-a3747709b35e service nova] Creating event network-vif-deleted:b91b9ec8-e9af-4ccd-9400-a8594f083719 for instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 on hv-cinder-85083 Sep 15 12:30:36.487505 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-35378ea9-4805-4107-be50-726424b1e54e req-8bcdc4dc-7f8e-47ef-8453-a3747709b35e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046061 Sep 15 12:30:36.488840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 333/685] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:30:36.541323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:36.550770 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:36.552374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:36.553701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9b91e471-997f-47e4-8dc6-4fa205b9f142 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1657 microversion: 2.20 time: 0.123300 Sep 15 12:30:36.554368 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 353/686] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:36 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1657 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:30:37.304697 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:37.305512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:37.311946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:37.312434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:37.312893 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:37.313615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:37.314063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:37.315007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:37.450239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:37.460225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e8b84e8f-a5bc-401b-a08a-85af4b177de7 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.159748 Sep 15 12:30:37.460850 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 334/687] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:37 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:37.579983 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:37.580597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:37.587381 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:37.587867 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:37.588355 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:37.589103 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:37.589555 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:37.589982 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:37.649975 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:37.657925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:37.659383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:37.660551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8d3c232a-7ef1-49db-8699-11ae281e2880 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1657 microversion: 2.20 time: 0.084942 Sep 15 12:30:37.661146 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 354/688] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:37 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1657 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:30:38.483095 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:38.483806 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:38.490744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:38.491217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:38.491647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:38.492327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:38.492789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:38.493209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:38.628985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:38.636577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-503c13dd-23e0-4711-bcc0-180a38fd0382 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.157251 Sep 15 12:30:38.637190 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 335/689] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:38 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:38.686352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:38.686965 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:38.693338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:38.693821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:38.694251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:38.694937 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:38.695386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:38.695808 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:38.759967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:38.768061 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:38.769512 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:38.770646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d4eb3f57-ee7f-482e-9b89-bbac79840047 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1657 microversion: 2.20 time: 0.088128 Sep 15 12:30:38.771204 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 355/690] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:38 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 12:30:39.659897 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:39.660518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:39.668078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:39.668702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:39.669236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:39.669938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:39.670418 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:39.671426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:39.795855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:39.796474 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:39.803284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:39.803767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:39.804198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:39.804908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:39.805361 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:39.805780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:39.818776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:39.826322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b523d3ad-8037-4d9c-a4c8-2a4dbde08723 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.171253 Sep 15 12:30:39.826891 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 336/691] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:39 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:39.838671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:39.839149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:39.839579 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:39.840020 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lazy-loading 'fault' on Instance uuid 602fceb0-200b-49d0-8c6f-28a5a36a8497 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:39.880603 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:39.888881 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:39.890353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c42d5435a514bc0880b69fbbc163d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d77a46e3c75435ca3632e12a4cb642e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:39.891594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fc75c84a-72de-43d7-bd36-46a1c7160d04 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 200 len: 1372 microversion: 2.20 time: 0.099933 Sep 15 12:30:39.892176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 356/692] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:39 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 12:30:40.848181 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:40.849094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:40.856134 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:40.856661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:40.857072 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:40.857754 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:40.858207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:40.858621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:40.917314 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:40.918028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:40.930075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:40.930685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:40.931278 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:40.935349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:40.936106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:40.936699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:40.970094 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] HTTP exception thrown: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Request method failure captured: Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 HTTP/1.1 Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3e1DewPlMi-ZmxOoUaJ8LkO-TSBY00vV91hALh9_gTB3sTu2FmmqbFtC_QNYzCWlv8V8TYp7jQwr7L55K_odJQZqCJk7to4xwghwmKCwn8VF6eeDPHNTz3NOOSoB6DPQJqFWVXnzjLAJLI3yQCIT-kR3fRpXw3wm3mAEBg9bb8xg Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:40.976483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 1c42d5435a514bc0880b69fbbc163d32 Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:40.978101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '602fceb0-200b-49d0-8c6f-28a5a36a8497'} Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:40.978952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:40.980216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:40.983395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Returning 404 to user: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:40.983395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c8009366-c9fc-4ba0-8355-a7815859f380 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 404 len: 111 microversion: 2.20 time: 0.065098 Sep 15 12:30:40.983395 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 357/693] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:40 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:30:41.008431 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2194421c-fce0-4a62-a8a0-f0770780d306 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '.version_select at 0x7ff0d0424940>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:41.020552 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:41.030365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ef5cfb6f-5267-4f40-a95a-b68efcf71728 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1314 microversion: 2.1 time: 0.185834 Sep 15 12:30:41.031738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 337/694] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:40 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:41.050828 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2194421c-fce0-4a62-a8a0-f0770780d306 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508200124" status: 204 len: 0 microversion: 2.20 time: 0.056404 Sep 15 12:30:41.051500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 358/695] 10.222.0.15 () {60 vars in 1262 bytes} [Thu Sep 15 12:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508200124 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 12:30:42.054386 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:42.055003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:42.062602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:42.063086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:42.063784 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:42.064620 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:42.065393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:42.066028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:42.210244 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:42.219879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-64253017-0658-4cd8-8d32-45802df0511c tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1499 microversion: 2.1 time: 0.169295 Sep 15 12:30:42.220964 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 338/696] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:42 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:45.068622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:45.069210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:45.079387 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.079889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.080538 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.081389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.081744 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.082171 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.112358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:30:45.154446 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:45.155429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:45.164301 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.168135 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.168586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.169406 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.169867 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.170305 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.192807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] HTTP exception thrown: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Request method failure captured: Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 HTTP/1.1 Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl3e1DewPlMi-ZmxOoUaJ8LkO-TSBY00vV91hALh9_gTB3sTu2FmmqbFtC_QNYzCWlv8V8TYp7jQwr7L55K_odJQZqCJk7to4xwghwmKCwn8VF6eeDPHNTz3NOOSoB6DPQJqFWVXnzjLAJLI3yQCIT-kR3fRpXw3wm3mAEBg9bb8xg Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:45.194920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 1c42d5435a514bc0880b69fbbc163d32 Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.196299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '602fceb0-200b-49d0-8c6f-28a5a36a8497'} Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:45.197214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.199775 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.201636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Returning 404 to user: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:45.201636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a0527cfc-324f-405a-84e6-08c105554993 tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 404 len: 111 microversion: 2.20 time: 0.046687 Sep 15 12:30:45.201636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 339/697] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 12:30:45 2022] DELETE /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:30:45.213752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:45.214618 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: 602fceb0-200b-49d0-8c6f-28a5a36a8497] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:45.218163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:45.230382 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.230929 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.231379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.232405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.239646 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.240168 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.271636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] HTTP exception thrown: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Request method failure captured: Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 HTTP/1.1 Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl3e1DewPlMi-ZmxOoUaJ8LkO-TSBY00vV91hALh9_gTB3sTu2FmmqbFtC_QNYzCWlv8V8TYp7jQwr7L55K_odJQZqCJk7to4xwghwmKCwn8VF6eeDPHNTz3NOOSoB6DPQJqFWVXnzjLAJLI3yQCIT-kR3fRpXw3wm3mAEBg9bb8xg Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:45.278787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 1c42d5435a514bc0880b69fbbc163d32 Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.280271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '602fceb0-200b-49d0-8c6f-28a5a36a8497'} Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:45.281194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. Sep 15 12:30:45.282496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:45.283561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Returning 404 to user: Instance 602fceb0-200b-49d0-8c6f-28a5a36a8497 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:45.283561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5f99c604-019c-48da-83f0-0f45077f831a tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497" status: 404 len: 111 microversion: 2.20 time: 0.073249 Sep 15 12:30:45.285379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 340/698] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:45 2022] GET /compute/v2.1/servers/602fceb0-200b-49d0-8c6f-28a5a36a8497 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:30:45.293966 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d9d47f23-cdf1-4037-b24b-0fc39d731d5f tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "DELETE /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 204 len: 0 microversion: 2.1 time: 0.235222 Sep 15 12:30:45.297306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 359/699] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:30:45 2022] DELETE /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:30:45.310279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:45.312813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:45.320954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.321796 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.322283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.323014 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:45.323458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:45.324042 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:45.516153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:45.528121 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fe56a84f-fdae-4e48-84e9-71e136bc1830 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1505 microversion: 2.1 time: 0.225660 Sep 15 12:30:45.528702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 341/700] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:45 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:46.472244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:46.472847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:46.485498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:46.485995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:46.486424 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:46.489760 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:46.490227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:46.490681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:46.508918 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] HTTP exception thrown: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Request method failure captured: Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 HTTP/1.1 Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxl3e1DewPlMi-ZmxOoUaJ8LkO-TSBY00vV91hALh9_gTB3sTu2FmmqbFtC_QNYzCWlv8V8TYp7jQwr7L55K_odJQZqCJk7to4xwghwmKCwn8VF6eeDPHNTz3NOOSoB6DPQJqFWVXnzjLAJLI3yQCIT-kR3fRpXw3wm3mAEBg9bb8xg Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:30:46.510812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 1c42d5435a514bc0880b69fbbc163d32 Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.512499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': 'ad7e2f44-79df-47c0-b85d-68b4b96e4590'} Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:46.513436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.514708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.515978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Returning 404 to user: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:46.515978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-36804cab-ebab-4ab2-ac1c-401f63a99cbd tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 404 len: 111 microversion: 2.20 time: 0.046866 Sep 15 12:30:46.517108 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 360/701] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 12:30:46 2022] DELETE /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:30:46.521609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:46.522220 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] [instance: ad7e2f44-79df-47c0-b85d-68b4b96e4590] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:46.527026 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=52 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:46.532184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:46.532677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:46.533474 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:46.534127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:46.534608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:46.535009 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:46.553611 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] HTTP exception thrown: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Request method failure captured: Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 HTTP/1.1 Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxl3e1DewPlMi-ZmxOoUaJ8LkO-TSBY00vV91hALh9_gTB3sTu2FmmqbFtC_QNYzCWlv8V8TYp7jQwr7L55K_odJQZqCJk7to4xwghwmKCwn8VF6eeDPHNTz3NOOSoB6DPQJqFWVXnzjLAJLI3yQCIT-kR3fRpXw3wm3mAEBg9bb8xg Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:46.555204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8d77a46e3c75435ca3632e12a4cb642e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 8d77a46e3c75435ca3632e12a4cb642e Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674449279 Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 1c42d5435a514bc0880b69fbbc163d32 Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674449279-project Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.556608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'ad7e2f44-79df-47c0-b85d-68b4b96e4590'} Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:46.557506 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. Sep 15 12:30:46.558756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:46.559886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] Returning 404 to user: Instance ad7e2f44-79df-47c0-b85d-68b4b96e4590 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:46.559886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0dadc489-08ff-44d0-ad2a-740c224e370d tempest-AttachVolumeShelveTestJSON-674449279 tempest-AttachVolumeShelveTestJSON-674449279-project] 10.222.0.15 "GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590" status: 404 len: 111 microversion: 2.20 time: 0.039250 Sep 15 12:30:46.560240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:46.561417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:46.562041 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 342/702] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 12:30:46 2022] GET /compute/v2.1/servers/ad7e2f44-79df-47c0-b85d-68b4b96e4590 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 12:30:46.570063 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:46.571353 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:46.572069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:46.573263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:46.573925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:46.574533 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:46.798483 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:46.812808 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-54e280c0-0fc5-4ef4-9fba-03ca6f44cb64 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1505 microversion: 2.1 time: 0.261691 Sep 15 12:30:46.814599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 361/703] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:46 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:30:47.689413 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-565e9f6a-8bef-41d0-9ceb-fdb59bdc1205 req-673b471b-87a6-4ace-a43c-9c2c80b8572d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327b0a6c-be02-439a-91cb-a98b0c98bc66", "name": "network-vif-deleted", "tag": "b86a7f2f-5559-4521-ad76-1d4958335a33"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:30:47.702123 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-565e9f6a-8bef-41d0-9ceb-fdb59bdc1205 req-673b471b-87a6-4ace-a43c-9c2c80b8572d service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:47.702601 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-565e9f6a-8bef-41d0-9ceb-fdb59bdc1205 req-673b471b-87a6-4ace-a43c-9c2c80b8572d service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:47.703027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-565e9f6a-8bef-41d0-9ceb-fdb59bdc1205 req-673b471b-87a6-4ace-a43c-9c2c80b8572d service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:47.718747 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-565e9f6a-8bef-41d0-9ceb-fdb59bdc1205 req-673b471b-87a6-4ace-a43c-9c2c80b8572d service nova] Creating event network-vif-deleted:b86a7f2f-5559-4521-ad76-1d4958335a33 for instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 on hv-cinder-85083 Sep 15 12:30:47.723710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-565e9f6a-8bef-41d0-9ceb-fdb59bdc1205 req-673b471b-87a6-4ace-a43c-9c2c80b8572d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039646 Sep 15 12:30:47.724310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 343/704] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:30:47.839786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:47.841191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:47.848841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:47.849628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:47.850306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:47.851191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:47.851867 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:47.852525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:47.905349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:47.906122 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:47.906572 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:47.907029 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lazy-loading 'fault' on Instance uuid 327b0a6c-be02-439a-91cb-a98b0c98bc66 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:30:47.969818 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0818d1847d5e42b6a942557f95b09d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092e830b85d3479a952d2e4ada193ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:30:47.986854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cb67dd69-bcff-4723-bc8d-22c0b5c540b4 tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 200 len: 1304 microversion: 2.1 time: 0.151268 Sep 15 12:30:47.987759 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 362/705] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:47 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:30:49.017249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:30:49.019154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] [instance: 327b0a6c-be02-439a-91cb-a98b0c98bc66] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:30:49.036214 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:49.037791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:49.039424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:49.040606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:30:49.042335 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:30:49.044304 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:30:49.085179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] HTTP exception thrown: Instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 could not be found. Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Request method failure captured: Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 HTTP/1.1 Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxrOHwAwwXwLOtdbwWb0Qd1bA1kN4-DhkdNFIEMiI0RWvG2DviH7DsIP4cisgzC2uNKGmMfyD_emvOIyexXXFJIXgaKpgV3RiOt4FbBgXXBkMR0S6eHvYxdxi9JjnK5aShs9fKyANS2zzbaNL7ykD6qU3D1YPGZ_3KT3GQKD0X3FVGs Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 092e830b85d3479a952d2e4ada193ab3 Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-VolumesActionsTest-458328811 Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:30:49.090429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/092e830b85d3479a952d2e4ada193ab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-VolumesActionsTest-458328811 Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 092e830b85d3479a952d2e4ada193ab3 Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-VolumesActionsTest-458328811 Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-VolumesActionsTest-458328811-project Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 0818d1847d5e42b6a942557f95b09d05 Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-VolumesActionsTest-458328811-project Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 could not be found. Sep 15 12:30:49.091909 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '327b0a6c-be02-439a-91cb-a98b0c98bc66'} Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 could not be found. Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:30:49.092702 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 could not be found. Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 could not be found. Sep 15 12:30:49.094161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:30:49.099142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] Returning 404 to user: Instance 327b0a6c-be02-439a-91cb-a98b0c98bc66 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:30:49.101976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-38e2b252-14fa-46ce-a145-957d6a9e566b tempest-VolumesActionsTest-458328811 tempest-VolumesActionsTest-458328811-project] 10.222.0.15 "GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66" status: 404 len: 111 microversion: 2.1 time: 0.092807 Sep 15 12:30:49.107159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 344/706] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:30:49 2022] GET /compute/v2.1/servers/327b0a6c-be02-439a-91cb-a98b0c98bc66 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:22.874508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1188966540", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:22.883079 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:22.883857 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:22.943714 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] validate_networks() for None {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:31:23.325427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:31:23.325895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:31:23.327055 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:31:23.327533 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:31:23.328289 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:31:23.338499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:23.339216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:23.339820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:23.340554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:23.341034 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:23.341462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:23.358862 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Getting quotas for project 617b2e1cc38d4faabe0ac41504480cb4. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:31:23.363441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Getting quotas for user b87556e083ae4854a4d26336490ccd1d and project 617b2e1cc38d4faabe0ac41504480cb4. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:31:23.375202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:31:23.378212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:31:23.433612 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ac02cbb5-114b-4773-8a3a-c06cf8bc85e4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562944 Sep 15 12:31:23.434485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 363/707] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:31:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:31:23.445514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-10b27f3f-e8cb-4a18-aba2-d3a04b66cf0b tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:23.446263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-10b27f3f-e8cb-4a18-aba2-d3a04b66cf0b tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:23.449837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=5 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:23.450663 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=77 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:23.512715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-10b27f3f-e8cb-4a18-aba2-d3a04b66cf0b tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:23.521035 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-10b27f3f-e8cb-4a18-aba2-d3a04b66cf0b tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1215 microversion: 2.1 time: 0.079185 Sep 15 12:31:23.521910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 345/708] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:23 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:24.544707 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:24.546628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:24.580281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:24.581062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:24.581561 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:24.582446 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:24.592373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:24.595532 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:24.692194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:24.700629 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-51c6d2b3-0572-4259-8bcd-a8843f663f38 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1275 microversion: 2.1 time: 0.160940 Sep 15 12:31:24.701599 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 364/709] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:24 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:25.729047 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:25.729047 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:25.734148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:25.734661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:25.735060 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:25.735756 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:25.736781 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:25.737217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:25.915928 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:25.927908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d33dd8cc-dd95-4502-826f-c86050cc4cd4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.204634 Sep 15 12:31:25.940886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 346/710] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:25 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:26.426120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-b6d7371b-1cc9-4f3f-9ac2-a3db8384bb73 req-119eb42d-2e76-4188-9029-1373fc70c992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96873ac0-055e-4036-b7d0-6be5f0a8eb8b", "tag": "80a33d04-c54f-490c-a461-50d9c6cd0291"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:26.438510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-b6d7371b-1cc9-4f3f-9ac2-a3db8384bb73 req-119eb42d-2e76-4188-9029-1373fc70c992 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:26.439937 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-b6d7371b-1cc9-4f3f-9ac2-a3db8384bb73 req-119eb42d-2e76-4188-9029-1373fc70c992 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:26.440586 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-b6d7371b-1cc9-4f3f-9ac2-a3db8384bb73 req-119eb42d-2e76-4188-9029-1373fc70c992 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:26.453638 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-b6d7371b-1cc9-4f3f-9ac2-a3db8384bb73 req-119eb42d-2e76-4188-9029-1373fc70c992 service nova] Creating event network-changed:80a33d04-c54f-490c-a461-50d9c6cd0291 for instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b on hv-cinder-85083 Sep 15 12:31:26.471041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-b6d7371b-1cc9-4f3f-9ac2-a3db8384bb73 req-119eb42d-2e76-4188-9029-1373fc70c992 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049098 Sep 15 12:31:26.471656 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 365/711] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:31:26.954234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:26.955357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:26.961797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:26.962290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:26.962726 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:26.963421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:26.963877 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:26.964302 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:27.093725 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:27.101346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e16a1cdf-0baf-4d43-8a3e-7252700af317 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.151419 Sep 15 12:31:27.101913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 347/712] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:26 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:28.125277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:28.126202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:28.133212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:28.133805 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:28.134344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:28.135139 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:28.135697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:28.136366 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:28.373745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:28.382953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8ee2c659-0421-4a2c-b6e5-321c43660a7c tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.262444 Sep 15 12:31:28.383655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 366/713] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:28 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:31:29.405622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:29.406238 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:29.413164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:29.413649 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:29.416953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:29.416953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:29.416953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:29.416953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:29.547143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:29.555527 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-13fc3e23-6192-44cc-96cd-93173bf1a6d4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.153776 Sep 15 12:31:29.556069 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 348/714] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:29 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:30.578646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:30.579266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:30.586360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:30.586853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:30.587290 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:30.588009 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:30.588462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:30.588932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:31.050323 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:31.054143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-9fcbc6e9-cdd4-4388-be7d-6b070e6544c4 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.479391 Sep 15 12:31:31.054984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 367/715] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:30 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:31.384976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-27591948-b81f-45c8-a4bb-92ca23112cc8 req-7c2fedbc-5db0-45a1-b9be-036e4dc3de2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96873ac0-055e-4036-b7d0-6be5f0a8eb8b", "name": "network-vif-plugged", "status": "completed", "tag": "80a33d04-c54f-490c-a461-50d9c6cd0291"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:31.398558 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-27591948-b81f-45c8-a4bb-92ca23112cc8 req-7c2fedbc-5db0-45a1-b9be-036e4dc3de2c service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:31.399252 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-27591948-b81f-45c8-a4bb-92ca23112cc8 req-7c2fedbc-5db0-45a1-b9be-036e4dc3de2c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:31.400116 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-27591948-b81f-45c8-a4bb-92ca23112cc8 req-7c2fedbc-5db0-45a1-b9be-036e4dc3de2c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:31.413791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-27591948-b81f-45c8-a4bb-92ca23112cc8 req-7c2fedbc-5db0-45a1-b9be-036e4dc3de2c service nova] Creating event network-vif-plugged:80a33d04-c54f-490c-a461-50d9c6cd0291 for instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b on hv-cinder-85083 Sep 15 12:31:31.419614 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-27591948-b81f-45c8-a4bb-92ca23112cc8 req-7c2fedbc-5db0-45a1-b9be-036e4dc3de2c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040740 Sep 15 12:31:31.421308 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 349/716] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:31:32.077095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:32.077707 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:32.085151 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:32.085640 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:32.086070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:32.086764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:32.087371 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:32.087790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:32.218309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:32.225960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fffee559-2969-4703-94d1-5c7a2d4fb952 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.152636 Sep 15 12:31:32.226521 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 368/717] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:32 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:33.250310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:33.250935 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:33.257643 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:33.258122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:33.258553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:33.259235 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:33.259681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:33.260097 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:33.392970 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:33.400879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-775b1991-353c-4717-a1eb-0fc6c63bb042 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.155168 Sep 15 12:31:33.401460 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 350/718] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:33 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:34.425403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:34.426028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:34.429136 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:34.430149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:34.436131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:34.436614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:34.437070 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:34.437757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:34.438203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:34.438618 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:34.568573 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:34.576330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e18f9ae0-2bdf-4246-991a-2f38b5c66421 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.155442 Sep 15 12:31:34.576922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 369/719] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:34 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:35.599047 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:35.599695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:35.602515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:35.608636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:35.609143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:35.609579 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:35.610263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:35.610714 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:35.611133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:35.746195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:35.754477 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3594b90e-32b8-4386-8b18-e47849ea3912 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1315 microversion: 2.1 time: 0.159284 Sep 15 12:31:35.755043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 351/720] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:35 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:36.344932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1769369567", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "networks": [{"uuid": "3c3f38b5-7fbc-487d-985d-7664d13cb0ae"}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:36.398809 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] validate_networks() for [('3c3f38b5-7fbc-487d-985d-7664d13cb0ae', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:31:36.758965 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:31:36.759384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:31:36.759930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:31:36.760389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:31:36.760856 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:31:36.770446 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:36.770988 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:36.771396 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:36.772241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:36.772726 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:36.773200 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:36.779966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:36.781188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:36.788019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:36.788501 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:36.789164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:36.789871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:36.790588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:36.790712 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Getting quotas for project daddeef840a04bb8bc0d7b1f8cb37c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:31:36.791175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:36.794621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Getting quotas for user f0a002a6c60e4666982e1cc74ed90573 and project daddeef840a04bb8bc0d7b1f8cb37c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:31:36.805615 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:31:36.807964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:31:36.853831 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e3af009c-0f36-48d8-a515-907430ce2758 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512613 Sep 15 12:31:36.854400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 370/721] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:31:36.865441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-59f9384a-7fb6-4405-a542-4a236d72548d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:36.866045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-59f9384a-7fb6-4405-a542-4a236d72548d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:36.931659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-59f9384a-7fb6-4405-a542-4a236d72548d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:36.939024 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-59f9384a-7fb6-4405-a542-4a236d72548d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1219 microversion: 2.1 time: 0.077560 Sep 15 12:31:36.939932 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 371/722] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:36 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:31:36.948212 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:36.959192 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5b7d452f-6a54-46d5-9e1e-7b7f6bb93ed8 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1465 microversion: 2.1 time: 0.182919 Sep 15 12:31:36.960685 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 352/723] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:36 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:37.008641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:37.009166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:37.015203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:37.015675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:37.016102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:37.016799 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:37.017243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:37.018279 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:37.044959 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:31:37.136352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-556da0e1-48e4-4051-ad1d-e38586a9c039 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "DELETE /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 204 len: 0 microversion: 2.1 time: 0.130819 Sep 15 12:31:37.136636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 372/724] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:31:37 2022] DELETE /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:31:37.144830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:37.145449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:37.151317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:37.151799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:37.152232 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:37.152966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:37.153415 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:37.153835 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:37.296433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:37.304828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6c1d3860-2f6f-42c9-b9a2-e08c32dea184 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1471 microversion: 2.1 time: 0.163853 Sep 15 12:31:37.305493 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 353/725] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:37 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:37.963086 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:37.963864 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:37.970774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:37.971404 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:37.971845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:37.972560 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:37.973228 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:37.973646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:38.035572 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:38.043094 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-646a78a1-f1f3-4f8a-8d44-6099316b3cc3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1223 microversion: 2.1 time: 0.084540 Sep 15 12:31:38.043661 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 373/726] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:37 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:38.330593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:38.331118 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:38.337693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:38.338176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:38.338612 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:38.339296 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:38.339746 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:38.340169 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:38.465099 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:38.472700 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8441b512-102f-462e-b217-7787e8033d7d tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1471 microversion: 2.1 time: 0.146050 Sep 15 12:31:38.473284 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 354/727] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:38 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:39.065427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:39.065977 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:39.073017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:39.074417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:39.075246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:39.075577 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:39.076066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:39.076495 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:39.140403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:39.147990 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-117d5677-d7f6-4f51-ba02-6a888c761f07 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1223 microversion: 2.1 time: 0.086448 Sep 15 12:31:39.148561 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 374/728] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:39 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:39.495553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:39.496165 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:39.502483 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:39.502954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:39.503385 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:39.504059 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:39.504510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:39.504958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:39.632283 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:39.639823 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a41c3258-45c4-4cf3-a052-5b4382dadbb0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1471 microversion: 2.1 time: 0.148175 Sep 15 12:31:39.640383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 355/729] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:39 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:40.170978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:40.172311 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:40.179181 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:40.179867 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:40.180484 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:40.181382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:40.181985 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:40.182559 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:40.250624 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:40.259772 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-4af74ab2-aa1d-4c87-94ed-f25375b3ae81 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1223 microversion: 2.1 time: 0.093347 Sep 15 12:31:40.260348 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 375/730] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:40 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:40.663608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:40.664426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:40.671147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:40.671923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:40.672356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:40.673441 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:40.674664 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:40.675093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:40.848213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:40.856606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0d124f5a-e47a-49f8-86b4-b2fe352ef99e tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1471 microversion: 2.1 time: 0.197163 Sep 15 12:31:40.857420 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 356/731] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:40 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:41.198029 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-8cfbd48c-5ff2-44a2-8ac9-48471c334091 req-daab04f3-958d-4bb3-a43e-806a15879697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96873ac0-055e-4036-b7d0-6be5f0a8eb8b", "name": "network-vif-deleted", "tag": "80a33d04-c54f-490c-a461-50d9c6cd0291"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:41.209002 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-8cfbd48c-5ff2-44a2-8ac9-48471c334091 req-daab04f3-958d-4bb3-a43e-806a15879697 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:41.209742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-8cfbd48c-5ff2-44a2-8ac9-48471c334091 req-daab04f3-958d-4bb3-a43e-806a15879697 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:41.210177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-8cfbd48c-5ff2-44a2-8ac9-48471c334091 req-daab04f3-958d-4bb3-a43e-806a15879697 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:41.222965 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-8cfbd48c-5ff2-44a2-8ac9-48471c334091 req-daab04f3-958d-4bb3-a43e-806a15879697 service nova] Creating event network-vif-deleted:80a33d04-c54f-490c-a461-50d9c6cd0291 for instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b on hv-cinder-85083 Sep 15 12:31:41.228471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-8cfbd48c-5ff2-44a2-8ac9-48471c334091 req-daab04f3-958d-4bb3-a43e-806a15879697 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Sep 15 12:31:41.229456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 376/732] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:31:41.283119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:41.284259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:41.290363 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:41.290849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:41.291370 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:41.292074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:41.292520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:41.292978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:41.356497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:41.364086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1b1031a5-0079-43bc-93e1-050fc37c297f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1271 microversion: 2.1 time: 0.084908 Sep 15 12:31:41.364653 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 357/733] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:41 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:41.881422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:41.882122 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:41.888144 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:41.888619 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:41.889082 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:41.889757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:41.890203 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:41.890623 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:41.951008 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:41.958665 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7e5ab5ec-a7fc-49e4-badc-ee0e7d0f93c0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1429 microversion: 2.1 time: 0.081888 Sep 15 12:31:41.959494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 377/734] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:41 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:42.386911 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:42.387519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:42.394087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:42.394577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:42.395015 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:42.395705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:42.396157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:42.396580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:42.456889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:42.464619 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b7eb5b9c-1ecd-42a2-9588-f85050dee8a1 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1271 microversion: 2.1 time: 0.081576 Sep 15 12:31:42.465219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 358/735] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:42 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:42.981721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:42.982339 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:42.988778 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:42.989284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:42.989721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:42.990411 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:42.990866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:42.991294 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:43.054745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87556e083ae4854a4d26336490ccd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b2e1cc38d4faabe0ac41504480cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:43.062321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ec544aae-c5cf-4ed0-bc33-e3c0ef4715e0 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 200 len: 1429 microversion: 2.1 time: 0.084476 Sep 15 12:31:43.062897 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 378/736] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:42 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 1429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:43.487774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:43.488471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:43.495193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:43.495677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:43.496348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:43.497074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:43.497529 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:43.497976 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:43.570838 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:43.578913 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e68e5873-7705-43dd-bdd4-9f63a84246de tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1279 microversion: 2.1 time: 0.095060 Sep 15 12:31:43.580049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 359/737] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:43 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:31:44.086742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:44.090202 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] [instance: 96873ac0-055e-4036-b7d0-6be5f0a8eb8b] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:44.098000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:44.098612 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:44.099435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:44.101377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:44.101877 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:44.102459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:44.120582 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] HTTP exception thrown: Instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b could not be found. Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Request method failure captured: Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b HTTP/1.1 Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxsZPDjR0gOZVBPKnb2c3ks0m3avmnqDM3MPL6uasc-BVXLlBiqKx-k8Oyir-gcdLYQxP_GAJpfnFMNad-dQpJ7N-QDAhb7I2RN3HmICs9pFO5g-b5NFX8GlxOZmsM4FlEDlsBVi8qgkqFcqqbckbM7mk_FjrNtjHAlbXnZhz7ATWnI Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 617b2e1cc38d4faabe0ac41504480cb4 Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesNegativeTest-1138119317 Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:31:44.122649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617b2e1cc38d4faabe0ac41504480cb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617b2e1cc38d4faabe0ac41504480cb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617b2e1cc38d4faabe0ac41504480cb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617b2e1cc38d4faabe0ac41504480cb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesNegativeTest-1138119317 Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 617b2e1cc38d4faabe0ac41504480cb4 Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesNegativeTest-1138119317 Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesNegativeTest-1138119317-project Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: b87556e083ae4854a4d26336490ccd1d Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesNegativeTest-1138119317-project Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b could not be found. Sep 15 12:31:44.124192 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '96873ac0-055e-4036-b7d0-6be5f0a8eb8b'} Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b could not be found. Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:31:44.125545 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b could not be found. Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b could not be found. Sep 15 12:31:44.127736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:31:44.130201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] Returning 404 to user: Instance 96873ac0-055e-4036-b7d0-6be5f0a8eb8b could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:31:44.130201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0cedec9f-c042-4a65-8104-214925b3e601 tempest-VolumesNegativeTest-1138119317 tempest-VolumesNegativeTest-1138119317-project] 10.222.0.15 "GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b" status: 404 len: 111 microversion: 2.1 time: 0.042661 Sep 15 12:31:44.130526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 379/738] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:44 2022] GET /compute/v2.1/servers/96873ac0-055e-4036-b7d0-6be5f0a8eb8b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:44.609797 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:44.610818 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:44.617378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:44.617858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:44.618497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:44.619188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:44.619808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:44.620230 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:44.767464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:44.777475 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a022c29a-abfa-4db5-b72c-15891dbd626a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.177357 Sep 15 12:31:44.778058 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 360/739] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:44 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:45.202508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-2e238353-7e6f-4bfd-a68e-9393911b718d req-a01d1a4c-eb45-4b73-900e-f38dce263ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1277ceee-b417-472d-b794-77666757066d", "tag": "45a2abc4-551b-4560-8cf5-db8532b1f395"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:45.225671 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-2e238353-7e6f-4bfd-a68e-9393911b718d req-a01d1a4c-eb45-4b73-900e-f38dce263ea1 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:45.226148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-2e238353-7e6f-4bfd-a68e-9393911b718d req-a01d1a4c-eb45-4b73-900e-f38dce263ea1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:45.226565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-2e238353-7e6f-4bfd-a68e-9393911b718d req-a01d1a4c-eb45-4b73-900e-f38dce263ea1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:45.242241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-2e238353-7e6f-4bfd-a68e-9393911b718d req-a01d1a4c-eb45-4b73-900e-f38dce263ea1 service nova] Creating event network-changed:45a2abc4-551b-4560-8cf5-db8532b1f395 for instance 1277ceee-b417-472d-b794-77666757066d on hv-cinder-85083 Sep 15 12:31:45.248121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-2e238353-7e6f-4bfd-a68e-9393911b718d req-a01d1a4c-eb45-4b73-900e-f38dce263ea1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048966 Sep 15 12:31:45.249903 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 380/740] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:31:45.799207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:45.799829 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:45.808132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:45.808724 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:45.809260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:45.810086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:45.810541 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:45.810960 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:45.951964 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:45.960921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-49b6a2a3-43ff-4407-94f7-f0e72c7ab3ce tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.165425 Sep 15 12:31:45.961491 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 361/741] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:45 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:46.985501 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:46.986741 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:46.990068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:46.990915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=8 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:46.997917 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:46.998586 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:46.999190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:46.999887 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:47.000630 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:47.001218 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:47.137895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:47.145950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0f71c887-561b-40ba-b726-ed7c95d608cb tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.165142 Sep 15 12:31:47.146508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 381/742] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:46 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:48.170990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:48.171687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:48.180282 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:48.180978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:48.181540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:48.182233 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:48.182682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:48.183100 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:48.328379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:48.337008 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-690046d9-3771-4052-9be3-c08b4b72bce8 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.171252 Sep 15 12:31:48.337566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 362/743] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:48 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:31:49.359659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:49.360386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:49.367905 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:49.368902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:49.369590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:49.370522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:49.371308 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:49.371953 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:49.540272 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:49.543989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:49.552997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-136483fd-f4f2-47ee-8f2d-5cc9c9e45e5a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.193175 Sep 15 12:31:49.553819 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 382/744] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:49 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:50.575519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:50.576133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:50.582662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:50.583142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:50.583583 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:50.584583 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:50.585067 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:50.585497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:50.589813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=100 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:50.716424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:50.724560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4f014c1d-1506-4898-a984-4e4c6403f155 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.153018 Sep 15 12:31:50.725151 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 363/745] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:50 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:51.407479 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-eec9f197-6121-480f-8b7d-8983dfb107e1 req-ebbb3f70-e5fe-473c-8e03-5ebf22c333ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277ceee-b417-472d-b794-77666757066d", "name": "network-vif-plugged", "status": "completed", "tag": "45a2abc4-551b-4560-8cf5-db8532b1f395"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:31:51.418558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-eec9f197-6121-480f-8b7d-8983dfb107e1 req-ebbb3f70-e5fe-473c-8e03-5ebf22c333ec service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:51.418845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-eec9f197-6121-480f-8b7d-8983dfb107e1 req-ebbb3f70-e5fe-473c-8e03-5ebf22c333ec service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:51.419226 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-eec9f197-6121-480f-8b7d-8983dfb107e1 req-ebbb3f70-e5fe-473c-8e03-5ebf22c333ec service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:51.431928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-eec9f197-6121-480f-8b7d-8983dfb107e1 req-ebbb3f70-e5fe-473c-8e03-5ebf22c333ec service nova] Creating event network-vif-plugged:45a2abc4-551b-4560-8cf5-db8532b1f395 for instance 1277ceee-b417-472d-b794-77666757066d on hv-cinder-85083 Sep 15 12:31:51.436839 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-eec9f197-6121-480f-8b7d-8983dfb107e1 req-ebbb3f70-e5fe-473c-8e03-5ebf22c333ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033041 Sep 15 12:31:51.437578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 383/746] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:31:51.747853 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:51.748472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:51.755385 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:51.755865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:51.756325 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:51.757063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:51.757520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:51.757948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:51.892250 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:51.900352 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7ac9eaa2-34a0-4fb6-9241-3af8b8fe77be tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.156330 Sep 15 12:31:51.900943 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 364/747] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:51 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:52.924462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:52.925209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:52.927847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:52.933383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:52.933865 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:52.934300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:52.934988 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:52.935448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:52.935877 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:53.075367 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:53.084552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a14c6d5a-78cf-4450-a0f7-91194deb8bf9 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.164482 Sep 15 12:31:53.085170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 384/748] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:52 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:54.107421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:54.108035 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:54.110379 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=43 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:54.116802 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:54.117298 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:54.117736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:54.118439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:54.118894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:54.119318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:54.257368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:54.264953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8dbcc398-c3cb-4117-a0bf-b45469c5cf3a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.161353 Sep 15 12:31:54.265520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 365/749] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:54 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:55.287117 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:55.287725 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:55.294834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:55.295309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:55.295742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:55.296423 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:55.297012 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:55.297432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:55.446681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:55.459206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a5293c78-d611-4bb7-9bba-0648f5420794 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.172480 Sep 15 12:31:55.460059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 385/750] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:55 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:56.482360 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:56.482973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:56.490677 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:56.491193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:56.491628 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:56.492334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:56.492804 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:56.493289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:56.627608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:56.635830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bc80a938-b3e8-46b3-babb-a5b263484572 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.157277 Sep 15 12:31:56.636401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 366/751] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:56 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:57.658985 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:57.659642 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:57.666835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:57.667318 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:57.667755 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:57.668444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:57.668926 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:57.669352 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:57.806303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:57.814053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-91f28cab-de4c-48f5-9515-8c559d5f672e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.159133 Sep 15 12:31:57.814626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 386/752] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:57 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:31:58.836608 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:31:58.837945 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:31:58.844965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:58.845575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:58.846005 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:58.846822 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:31:58.847270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:31:58.847767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:31:58.988206 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:31:58.996697 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-06b347fb-c358-45bf-a53a-c1193f84e8af tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1319 microversion: 2.1 time: 0.164986 Sep 15 12:31:58.997297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 367/753] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:31:58 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:00.019210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:00.019846 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:00.026216 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:00.026690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:00.027125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:00.027812 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:00.028265 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:00.028687 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:00.154922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:00.162718 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-173b11f8-b09a-4cce-8b4b-b14146e50dac tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1508 microversion: 2.1 time: 0.147535 Sep 15 12:32:00.163290 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 387/754] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:00 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:21.689122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=5 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:21.689868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=28 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:21.693925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb1d416-0c5e-4d3b-8273-8254273b3939", "device": "/dev/sdb"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:32:21.696734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:21.703764 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:21.704235 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:21.704662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:21.705372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:21.705818 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:21.706254 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:21.942728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e8b45e08-1dc8-4cd7-904e-cb754a8acf45 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "POST /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254873 Sep 15 12:32:21.943419 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 368/755] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:32:21 2022] POST /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:32:43.547673 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:43.548171 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:43.550848 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=7 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:43.551498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=26 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:43.557544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:43.558026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:43.558471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:43.559161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:43.559614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:43.560041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:43.643648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lazy-loading 'services' on Instance uuid 1277ceee-b417-472d-b794-77666757066d {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:32:43.716563 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c87e670d-4a4b-4caf-be7c-727c5059550f tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d/os-volume_attachments/8eb1d416-0c5e-4d3b-8273-8254273b3939" status: 202 len: 0 microversion: 2.1 time: 0.172735 Sep 15 12:32:43.717193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 388/756] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:32:43 2022] DELETE /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d/os-volume_attachments/8eb1d416-0c5e-4d3b-8273-8254273b3939 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:32:44.840435 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:44.841227 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:44.846136 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:44.846718 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:44.855171 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:44.855644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:44.856240 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:44.856959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:44.857412 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:44.857834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:44.883863 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Going to try to terminate instance {{(pid=120436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:32:44.957763 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d9da9783-9a07-4859-b856-042aad885888 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 204 len: 0 microversion: 2.1 time: 0.119240 Sep 15 12:32:44.962377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 369/757] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:32:44 2022] DELETE /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:32:44.968544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:44.969916 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:44.976357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:44.976870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:44.977744 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:44.977968 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:44.978410 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:44.978824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:45.109237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:45.117499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-edc0a2b0-22d7-4f28-85f0-600317916ef7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1514 microversion: 2.1 time: 0.153676 Sep 15 12:32:45.118068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 389/758] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:44 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:46.142260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:46.142965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:46.149888 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:46.150368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:46.150803 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:46.151487 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:46.151934 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:46.152356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:46.277836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:46.285394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9c06f160-98df-4e90-87a9-8bcbd75e54f7 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1514 microversion: 2.1 time: 0.147409 Sep 15 12:32:46.285966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 370/759] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:46 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:47.099295 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-d7b5a4fa-625b-42d7-9542-c2e1d982d698 req-0dc6a078-ca6f-4dcf-a99e-91f1d45c7f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277ceee-b417-472d-b794-77666757066d", "name": "network-vif-deleted", "tag": "45a2abc4-551b-4560-8cf5-db8532b1f395"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:32:47.110266 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-d7b5a4fa-625b-42d7-9542-c2e1d982d698 req-0dc6a078-ca6f-4dcf-a99e-91f1d45c7f4f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:47.110737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-d7b5a4fa-625b-42d7-9542-c2e1d982d698 req-0dc6a078-ca6f-4dcf-a99e-91f1d45c7f4f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:47.111169 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-d7b5a4fa-625b-42d7-9542-c2e1d982d698 req-0dc6a078-ca6f-4dcf-a99e-91f1d45c7f4f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:47.122620 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-d7b5a4fa-625b-42d7-9542-c2e1d982d698 req-0dc6a078-ca6f-4dcf-a99e-91f1d45c7f4f service nova] Creating event network-vif-deleted:45a2abc4-551b-4560-8cf5-db8532b1f395 for instance 1277ceee-b417-472d-b794-77666757066d on hv-cinder-85083 Sep 15 12:32:47.127450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-d7b5a4fa-625b-42d7-9542-c2e1d982d698 req-0dc6a078-ca6f-4dcf-a99e-91f1d45c7f4f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031773 Sep 15 12:32:47.128042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 390/760] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:32:47.307425 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:47.308037 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:47.314461 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:47.314938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:47.315371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:47.316051 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:47.316497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:47.316955 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:47.350351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:47.350820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:47.351249 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:47.351688 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lazy-loading 'fault' on Instance uuid 1277ceee-b417-472d-b794-77666757066d {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:32:47.390681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:47.398748 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ca24d4cc-8853-495b-a553-47796999d340 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 200 len: 1309 microversion: 2.1 time: 0.095141 Sep 15 12:32:47.399320 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 371/761] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:47 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:48.422544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:48.423234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: 1277ceee-b417-472d-b794-77666757066d] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:48.429923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:48.430390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:48.430824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:48.431496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:48.431939 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:48.432357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:48.445037 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] HTTP exception thrown: Instance 1277ceee-b417-472d-b794-77666757066d could not be found. Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Request method failure captured: Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d HTTP/1.1 Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIxsj9DvEOdSOuQLYYbzdJnpEu1FN3NENUg08uC2mmED3xTlGslQ7FJXDR2IP8JFeZXNU3WDolyYAc_S1-fCBCgjp3pg7AFZfAVPeQf-FmvhlZu4cLVsXRkOIA2Epnu3t32C-vaKRfFcEUpNdgbFaGkAO68Ls5rNRCpwuuurZVSPbpMY Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: daddeef840a04bb8bc0d7b1f8cb37c7b Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-VolumesSnapshotTestJSON-629358076 Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:32:48.446628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-VolumesSnapshotTestJSON-629358076 Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: daddeef840a04bb8bc0d7b1f8cb37c7b Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-629358076 Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-VolumesSnapshotTestJSON-629358076-project Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: f0a002a6c60e4666982e1cc74ed90573 Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-VolumesSnapshotTestJSON-629358076-project Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 1277ceee-b417-472d-b794-77666757066d could not be found. Sep 15 12:32:48.448250 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '1277ceee-b417-472d-b794-77666757066d'} Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1277ceee-b417-472d-b794-77666757066d could not be found. Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:32:48.449330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1277ceee-b417-472d-b794-77666757066d could not be found. Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1277ceee-b417-472d-b794-77666757066d could not be found. Sep 15 12:32:48.450941 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:32:48.452590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Returning 404 to user: Instance 1277ceee-b417-472d-b794-77666757066d could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:32:48.452590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f38e36f7-ee5a-457b-b1a4-8b8c905f8e22 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d" status: 404 len: 111 microversion: 2.1 time: 0.030063 Sep 15 12:32:48.452590 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 391/762] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:48 2022] GET /compute/v2.1/servers/1277ceee-b417-472d-b794-77666757066d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:32:56.326445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-452775980", "imageRef": "5e58f789-00bd-42cb-b5a9-9009adb7614a", "flavorRef": "452", "networks": [{"uuid": "3c3f38b5-7fbc-487d-985d-7664d13cb0ae"}]}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:32:56.380295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] validate_networks() for [('3c3f38b5-7fbc-487d-985d-7664d13cb0ae', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:32:56.716182 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:32:56.716600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:32:56.717122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:32:56.717632 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:32:56.718043 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:32:56.727761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:56.728242 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:56.728668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:56.729431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:56.729884 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:56.730307 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:56.746604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Getting quotas for project daddeef840a04bb8bc0d7b1f8cb37c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:32:56.750520 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Getting quotas for user f0a002a6c60e4666982e1cc74ed90573 and project daddeef840a04bb8bc0d7b1f8cb37c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:32:56.761371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:32:56.763655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e58f789-00bd-42cb-b5a9-9009adb7614a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:32:56.809925 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-97c3f873-0257-4814-acdb-8a82582465f3 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487239 Sep 15 12:32:56.810574 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 372/763] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 12:32:56.821631 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6feff996-b731-4459-a758-fe801a712601 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:56.822254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6feff996-b731-4459-a758-fe801a712601 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:56.880692 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6feff996-b731-4459-a758-fe801a712601 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:56.888586 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6feff996-b731-4459-a758-fe801a712601 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1218 microversion: 2.1 time: 0.070747 Sep 15 12:32:56.889173 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 392/764] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:56 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:57.912866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:57.914057 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:57.920383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:57.921126 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:57.921783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:57.922656 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:57.923292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:57.923898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:58.001734 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:58.009915 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8ca05e53-c80d-414b-9a4f-4484179cb28c tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1288 microversion: 2.1 time: 0.102201 Sep 15 12:32:58.010586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 373/765] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:57 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:32:59.032835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:32:59.033453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:32:59.035948 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:59.042159 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:59.042847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:59.043283 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:59.044002 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:59.044456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:59.044900 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:59.148463 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-5d5bcad2-8a4c-4475-9280-07ef61d434ce req-cbe66ee8-663b-43c4-8f3a-f456596d2518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87d197d-3b29-4689-ab2d-705011fda118", "tag": "84d76f59-5801-422f-93da-2c72934f6d3c"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:32:59.162094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5d5bcad2-8a4c-4475-9280-07ef61d434ce req-cbe66ee8-663b-43c4-8f3a-f456596d2518 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:32:59.162992 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5d5bcad2-8a4c-4475-9280-07ef61d434ce req-cbe66ee8-663b-43c4-8f3a-f456596d2518 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:32:59.163416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5d5bcad2-8a4c-4475-9280-07ef61d434ce req-cbe66ee8-663b-43c4-8f3a-f456596d2518 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:32:59.175758 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-5d5bcad2-8a4c-4475-9280-07ef61d434ce req-cbe66ee8-663b-43c4-8f3a-f456596d2518 service nova] Creating event network-changed:84d76f59-5801-422f-93da-2c72934f6d3c for instance e87d197d-3b29-4689-ab2d-705011fda118 on hv-cinder-85083 Sep 15 12:32:59.180928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:32:59.181833 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-5d5bcad2-8a4c-4475-9280-07ef61d434ce req-cbe66ee8-663b-43c4-8f3a-f456596d2518 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038021 Sep 15 12:32:59.182644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 374/766] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:32:59.189856 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5fdc9577-d3bd-4065-873a-2db33dd6a507 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1318 microversion: 2.1 time: 0.160851 Sep 15 12:32:59.190659 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 393/767] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:32:59 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:00.215169 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:00.215856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:00.221901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:00.222378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:00.222805 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:00.223478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:00.223923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:00.224345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:00.353142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:00.360668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8f54ccb8-912a-4ced-8c81-1a119884a63e tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1318 microversion: 2.1 time: 0.150167 Sep 15 12:33:00.361264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 375/768] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:00 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:01.382962 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:01.383490 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:01.389950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:01.390423 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:01.390849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:01.391526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:01.391969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:01.392386 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:01.517706 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:01.525745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f4cbd905-d268-4c17-8349-050af42035a0 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1318 microversion: 2.1 time: 0.146679 Sep 15 12:33:01.526505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 394/769] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:01 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:02.549184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:02.549788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:02.556480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:02.556990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:02.557421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:02.558101 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:02.558546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:02.558963 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:02.683705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:02.692025 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9b998638-d343-4648-80cc-4468cfa24294 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1318 microversion: 2.1 time: 0.146685 Sep 15 12:33:02.692589 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 376/770] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:02 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:33:03.623359 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-77e831a3-6c41-4191-a2b0-29efcdf1a2eb req-d077d871-cdfd-465f-a36b-adf109062774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87d197d-3b29-4689-ab2d-705011fda118", "name": "network-vif-plugged", "status": "completed", "tag": "84d76f59-5801-422f-93da-2c72934f6d3c"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:33:03.634565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-77e831a3-6c41-4191-a2b0-29efcdf1a2eb req-d077d871-cdfd-465f-a36b-adf109062774 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:03.635042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-77e831a3-6c41-4191-a2b0-29efcdf1a2eb req-d077d871-cdfd-465f-a36b-adf109062774 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:03.635474 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-77e831a3-6c41-4191-a2b0-29efcdf1a2eb req-d077d871-cdfd-465f-a36b-adf109062774 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:03.648205 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-77e831a3-6c41-4191-a2b0-29efcdf1a2eb req-d077d871-cdfd-465f-a36b-adf109062774 service nova] Creating event network-vif-plugged:84d76f59-5801-422f-93da-2c72934f6d3c for instance e87d197d-3b29-4689-ab2d-705011fda118 on hv-cinder-85083 Sep 15 12:33:03.653508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-77e831a3-6c41-4191-a2b0-29efcdf1a2eb req-d077d871-cdfd-465f-a36b-adf109062774 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033651 Sep 15 12:33:03.654098 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 395/771] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:33:03.714648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:03.715368 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:03.721954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:03.722449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:03.722956 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:03.723736 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:03.724289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:03.724710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:03.855512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:03.863757 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-31f999ac-701e-46c4-ba52-3e0632e3508d tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1318 microversion: 2.1 time: 0.152950 Sep 15 12:33:03.865482 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 377/772] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:03 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:04.888320 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:04.889091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:04.895222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:04.895697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:04.896790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:04.897453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:04.897930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:04.898346 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:05.024621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:05.032209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8f67c1c0-a05b-4925-8edb-07297cd851ee tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1318 microversion: 2.1 time: 0.148520 Sep 15 12:33:05.032794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 396/773] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:04 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:06.054343 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:06.054951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:06.061391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:06.061866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:06.062295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:06.062971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:06.063431 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:06.063835 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:06.197312 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:06.205063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ac29e3f0-ad0c-422b-afcb-105cf8f88626 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1506 microversion: 2.1 time: 0.154518 Sep 15 12:33:06.205630 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 378/774] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:06 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:06.228290 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bcd55d3-57d9-4182-8688-d57911e904d4", "device": "/dev/sdb"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:33:06.231058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:06.237451 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:06.237923 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:06.238350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:06.239025 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:06.239469 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:06.239886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:06.469987 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ae7676ba-7938-4eaa-8c55-84b5567ad2e4 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "POST /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245468 Sep 15 12:33:06.477609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 397/775] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:33:06 2022] POST /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:33:24.761078 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:24.761575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:24.764044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:24.764673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=6 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:24.766334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:24.767218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:24.775044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:24.775523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:24.775958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:24.776644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:24.777126 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:24.777546 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:24.865064 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lazy-loading 'services' on Instance uuid e87d197d-3b29-4689-ab2d-705011fda118 {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:33:24.939318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-99db29a2-c848-46ff-924a-2b04cfe5021b tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118/os-volume_attachments/3bcd55d3-57d9-4182-8688-d57911e904d4" status: 202 len: 0 microversion: 2.1 time: 0.181878 Sep 15 12:33:24.940267 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 379/776] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:33:24 2022] DELETE /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118/os-volume_attachments/3bcd55d3-57d9-4182-8688-d57911e904d4 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:33:26.066324 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:26.067715 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=22 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:26.068373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:26.072539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:26.073155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:26.081512 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:26.081991 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:26.082425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:26.083109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:26.083556 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:26.083976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:26.108842 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:33:26.181046 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e4e98c6e-df43-432c-9edd-00c69ff48fda tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 204 len: 0 microversion: 2.1 time: 0.116477 Sep 15 12:33:26.181816 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 398/777] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:33:26 2022] DELETE /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:33:26.191207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:26.192598 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:26.198687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:26.199166 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:26.199594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:26.200272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:26.200716 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:26.201154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:26.327454 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:26.335332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6baa7c68-08d5-4f69-89fc-dc9b39fe9f36 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1512 microversion: 2.1 time: 0.149075 Sep 15 12:33:26.335896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 380/778] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:26 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:27.360149 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:27.360795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:27.367191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:27.367672 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:27.368107 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:27.368814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:27.369268 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:27.369699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:27.499584 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:27.507868 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cb03e5b8-61d6-4461-9af2-26200517f59a tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1512 microversion: 2.1 time: 0.152044 Sep 15 12:33:27.508467 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 399/779] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:27 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:28.314294 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-dada48a3-4a6b-4836-95eb-95441f9b1fdf req-8244c9ab-4963-483b-ade5-ea9c8fa6a40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87d197d-3b29-4689-ab2d-705011fda118", "name": "network-vif-deleted", "tag": "84d76f59-5801-422f-93da-2c72934f6d3c"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:33:28.324938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-dada48a3-4a6b-4836-95eb-95441f9b1fdf req-8244c9ab-4963-483b-ade5-ea9c8fa6a40c service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:28.325405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-dada48a3-4a6b-4836-95eb-95441f9b1fdf req-8244c9ab-4963-483b-ade5-ea9c8fa6a40c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:28.325831 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-dada48a3-4a6b-4836-95eb-95441f9b1fdf req-8244c9ab-4963-483b-ade5-ea9c8fa6a40c service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:28.337661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-dada48a3-4a6b-4836-95eb-95441f9b1fdf req-8244c9ab-4963-483b-ade5-ea9c8fa6a40c service nova] Creating event network-vif-deleted:84d76f59-5801-422f-93da-2c72934f6d3c for instance e87d197d-3b29-4689-ab2d-705011fda118 on hv-cinder-85083 Sep 15 12:33:28.342991 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-dada48a3-4a6b-4836-95eb-95441f9b1fdf req-8244c9ab-4963-483b-ade5-ea9c8fa6a40c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032284 Sep 15 12:33:28.343571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 381/780] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:33:28.530919 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:28.531536 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:28.538668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:28.539148 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:28.539583 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:28.540269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:28.540722 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:28.541166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:28.571184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:28.571655 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:28.572087 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:28.572526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lazy-loading 'fault' on Instance uuid e87d197d-3b29-4689-ab2d-705011fda118 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:33:28.611519 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a002a6c60e4666982e1cc74ed90573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daddeef840a04bb8bc0d7b1f8cb37c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:33:28.619174 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8938185a-d2b3-494a-a38d-952114e56775 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 200 len: 1308 microversion: 2.1 time: 0.092117 Sep 15 12:33:28.619746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 400/781] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:28 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:33:29.643617 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:33:29.644316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] [instance: e87d197d-3b29-4689-ab2d-705011fda118] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:33:29.651073 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:29.651553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:29.651990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:29.652671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:33:29.653156 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:33:29.653581 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:33:29.667173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] HTTP exception thrown: Instance e87d197d-3b29-4689-ab2d-705011fda118 could not be found. Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Request method failure captured: Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 HTTP/1.1 Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxsj9DvEOdSOuQLYYbzdJnpEu1FN3NENUg08uC2mmED3xTlGslQ7FJXDR2IP8JFeZXNU3WDolyYAc_S1-fCBCgjp3pg7AFZfAVPeQf-FmvhlZu4cLVsXRkOIA2Epnu3t32C-vaKRfFcEUpNdgbFaGkAO68Ls5rNRCpwuuurZVSPbpMY Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: daddeef840a04bb8bc0d7b1f8cb37c7b Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-VolumesSnapshotTestJSON-629358076 Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:33:29.668773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daddeef840a04bb8bc0d7b1f8cb37c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-VolumesSnapshotTestJSON-629358076 Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: daddeef840a04bb8bc0d7b1f8cb37c7b Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-629358076 Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-VolumesSnapshotTestJSON-629358076-project Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: f0a002a6c60e4666982e1cc74ed90573 Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-VolumesSnapshotTestJSON-629358076-project Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance e87d197d-3b29-4689-ab2d-705011fda118 could not be found. Sep 15 12:33:29.670517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'e87d197d-3b29-4689-ab2d-705011fda118'} Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e87d197d-3b29-4689-ab2d-705011fda118 could not be found. Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:33:29.671449 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e87d197d-3b29-4689-ab2d-705011fda118 could not be found. Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e87d197d-3b29-4689-ab2d-705011fda118 could not be found. Sep 15 12:33:29.673024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:33:29.674749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] Returning 404 to user: Instance e87d197d-3b29-4689-ab2d-705011fda118 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:33:29.674749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-21fa94ff-9310-4d7c-822c-4b4bced65241 tempest-VolumesSnapshotTestJSON-629358076 tempest-VolumesSnapshotTestJSON-629358076-project] 10.222.0.15 "GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118" status: 404 len: 111 microversion: 2.1 time: 0.031205 Sep 15 12:33:29.674749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 382/782] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:33:29 2022] GET /compute/v2.1/servers/e87d197d-3b29-4689-ab2d-705011fda118 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:34:10.575448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0111dc05-a268-446d-8b1f-4b0aa8a6fa87 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Action: 'create', calling method: .version_select at 0x7ff0d04153a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-938883156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZFphxkYkmnh0J/2pxRnQaMrW5kFd3RWELLHwII9YI4Jr8hDygdahWQbFKMjRb+zrczb1jnVjYNYFKsiLchNgT0Yqo/Ak5iAiY6LPvvXXjeLlifHVv9d0KDTlH1jWWKKQ=="}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:10.582525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:10.583194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:10.597160 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-0111dc05-a268-446d-8b1f-4b0aa8a6fa87 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Getting quotas for project 84b799b1cfab4245bf9fbfce0faf036a. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:34:10.601492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-0111dc05-a268-446d-8b1f-4b0aa8a6fa87 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Getting quotas for user 08bd9f54467341afacba19215b78bf59 and project 84b799b1cfab4245bf9fbfce0faf036a. Resources: {'key_pairs'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:34:10.623822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0111dc05-a268-446d-8b1f-4b0aa8a6fa87 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052362 Sep 15 12:34:10.624414 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 401/783] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:34:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:34:10.675194 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1970639416", "imageRef": "ca97ee86-4238-44a8-abfb-a896504845ae", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-938883156", "networks": [{"uuid": "efc29ccb-6fe5-489a-adf0-b939fe52c04c"}]}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:10.684662 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=8 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:10.685462 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:10.859698 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.network.neutron [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] validate_networks() for [('efc29ccb-6fe5-489a-adf0-b939fe52c04c', None, None, None, None, None)] {{(pid=120436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:34:11.220782 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Flavor limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:34:11.221232 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Image limits 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:34:11.221708 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Flavor pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:34:11.222124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Image pref 0:0:0 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:34:11.222536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.virt.hardware [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:34:11.231515 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:11.231986 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:11.232447 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:11.233224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:11.233672 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:11.234093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:11.251028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Getting quotas for project 84b799b1cfab4245bf9fbfce0faf036a. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:34:11.255570 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Getting quotas for user 08bd9f54467341afacba19215b78bf59 and project 84b799b1cfab4245bf9fbfce0faf036a. Resources: {'ram', 'cores', 'instances'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:34:11.266237 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Going to run 1 instances... {{(pid=120436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:34:11.268441 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca97ee86-4238-44a8-abfb-a896504845ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:34:11.313509 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f2928168-80e0-4ccb-a011-7132dc96246f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642741 Sep 15 12:34:11.314688 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 383/784] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:34:11.325798 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-152faa2d-a488-49c4-bb7d-d3acdb566049 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:11.326404 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-152faa2d-a488-49c4-bb7d-d3acdb566049 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:11.386869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-152faa2d-a488-49c4-bb7d-d3acdb566049 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:11.397662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-152faa2d-a488-49c4-bb7d-d3acdb566049 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1258 microversion: 2.1 time: 0.076170 Sep 15 12:34:11.398232 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 402/785] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:11 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:12.419712 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:12.420318 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:12.427669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:12.428394 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:12.428879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:12.429762 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:12.430217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:12.430641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:12.495999 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:12.503942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-78ca624b-079a-4588-8824-9742755ef813 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1328 microversion: 2.1 time: 0.088306 Sep 15 12:34:12.504514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 384/786] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:12 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1328 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:34:13.528450 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:13.529178 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:13.536949 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:13.537771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:13.538350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:13.539206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:13.539795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:13.540514 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:13.795643 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:13.804573 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e9433e7f-5abe-44cb-b9f1-eecde37869d7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.280349 Sep 15 12:34:13.822780 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 403/787] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:13 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:14.833688 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:14.835025 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:14.844495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:14.845387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:14.846300 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:14.847358 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:14.848027 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:14.848690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:14.999644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:15.016044 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d8fd8c94-3604-450b-8ba5-f6b29dcf465d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.186893 Sep 15 12:34:15.020167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 385/788] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:14 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:16.039113 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:16.039745 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:16.046169 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:16.046667 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:16.047085 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:16.047835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:16.048337 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:16.048790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:16.199272 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:16.212049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ea5ff218-03cb-4e49-8253-77b742b81a68 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.176724 Sep 15 12:34:16.212914 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 404/789] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:16 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:17.235049 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:17.235789 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:17.242694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:17.243191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:17.243615 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:17.244317 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:17.244784 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:17.245215 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:17.377413 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:17.386707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-86f7d6a7-1029-4ad3-8b25-01d152af6d43 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.155538 Sep 15 12:34:17.387300 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 386/790] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:17 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:18.411754 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:18.412365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:18.419026 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:18.419512 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:18.419949 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:18.420641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:18.421116 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:18.421542 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:18.567173 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:18.585620 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-79107efb-b08b-49cd-92bf-0bac7a851a66 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.178089 Sep 15 12:34:18.587471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 405/791] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:18 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:19.609865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:19.611133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:19.617461 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:19.617967 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:19.618402 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:19.619087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:19.619538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:19.619962 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:19.770153 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:19.778821 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-0355c543-76c8-452b-b437-06920bbf4dc5 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.172751 Sep 15 12:34:19.790293 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 387/792] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:19 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:20.803730 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:20.804402 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:20.811354 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:20.811824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:20.812255 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:20.813042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:20.813487 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:20.813903 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:20.941484 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:20.949122 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-da908f06-1cba-49d8-9d90-3f190db319c8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.149355 Sep 15 12:34:20.949689 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 406/793] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:20 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:21.792828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-78256a2e-05b8-4cea-be19-193b5a9724b4 req-39469b4c-d80d-455d-9dd6-0a6c29e98537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:21.798571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:21.799786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=6 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:21.806485 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-78256a2e-05b8-4cea-be19-193b5a9724b4 req-39469b4c-d80d-455d-9dd6-0a6c29e98537 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:21.806958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-78256a2e-05b8-4cea-be19-193b5a9724b4 req-39469b4c-d80d-455d-9dd6-0a6c29e98537 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:21.807382 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-78256a2e-05b8-4cea-be19-193b5a9724b4 req-39469b4c-d80d-455d-9dd6-0a6c29e98537 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:21.817975 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-78256a2e-05b8-4cea-be19-193b5a9724b4 req-39469b4c-d80d-455d-9dd6-0a6c29e98537 service nova] Creating event network-changed:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:34:21.823184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-78256a2e-05b8-4cea-be19-193b5a9724b4 req-39469b4c-d80d-455d-9dd6-0a6c29e98537 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034051 Sep 15 12:34:21.824082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 388/794] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:34:21.972922 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:21.973549 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:21.976032 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:21.982962 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:21.983444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:21.983882 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:21.984585 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:21.985066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:21.985489 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:22.112173 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:22.120516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-97b272f4-40fc-4245-97e6-aae25135578d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.152384 Sep 15 12:34:22.121118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 407/795] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:21 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:23.147684 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:23.148408 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:23.154566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:23.155040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:23.155472 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:23.156149 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:23.156594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:23.157042 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:23.285173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:23.292669 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2cddae58-3037-4de1-8627-ef37801f9fe2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.149771 Sep 15 12:34:23.293262 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 389/796] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:23 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:24.317275 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:24.317890 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:24.324701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:24.325293 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:24.325918 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:24.326620 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:24.327075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:24.327502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:24.453271 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:24.461807 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0235cdda-5298-46e8-a4aa-d03ab6a51588 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.148431 Sep 15 12:34:24.462374 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 408/797] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:24 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:25.484222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:25.484858 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:25.491258 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:25.491739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:25.492167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:25.492876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:25.493321 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:25.493735 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:25.617862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:25.625292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-67e95d68-64b9-4654-8f82-bd57a924ee47 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.144875 Sep 15 12:34:25.625849 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 390/798] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:25 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:25.980065 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-cafafbf6-346b-4166-baaa-8b180994952f req-735fc21a-5072-4300-b965-dc00602df5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "name": "network-vif-plugged", "status": "completed", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:25.990430 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-cafafbf6-346b-4166-baaa-8b180994952f req-735fc21a-5072-4300-b965-dc00602df5d1 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:25.990942 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-cafafbf6-346b-4166-baaa-8b180994952f req-735fc21a-5072-4300-b965-dc00602df5d1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:25.991372 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-cafafbf6-346b-4166-baaa-8b180994952f req-735fc21a-5072-4300-b965-dc00602df5d1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:26.002324 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-cafafbf6-346b-4166-baaa-8b180994952f req-735fc21a-5072-4300-b965-dc00602df5d1 service nova] Creating event network-vif-plugged:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:34:26.007154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-cafafbf6-346b-4166-baaa-8b180994952f req-735fc21a-5072-4300-b965-dc00602df5d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030788 Sep 15 12:34:26.007748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 409/799] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:34:26.648242 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:26.648876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:26.655346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:26.655824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:26.656257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:26.656974 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:26.657424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:26.657846 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:27.000928 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:27.009271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-35f16f36-4313-461b-9c6d-32a7c6bee23f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1358 microversion: 2.1 time: 0.364826 Sep 15 12:34:27.009822 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 391/800] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:26 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:28.031707 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:28.032417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:28.038787 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.039269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.039698 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.040380 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.040863 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.041285 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.169152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:28.177319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a6271c79-9eb6-43a3-bbe5-cf4fd57b1ae1 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1547 microversion: 2.1 time: 0.150393 Sep 15 12:34:28.177889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 410/801] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:28 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:28.199606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:28.200263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:28.206959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.207439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.207874 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.208559 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.209039 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.209460 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.337348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:28.345706 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fca1b4dc-6251-4ead-8306-d28c436e4989 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1547 microversion: 2.1 time: 0.149317 Sep 15 12:34:28.346280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 392/802] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:28 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:28.367063 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:28.371802 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:28.372565 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Searching by: {'deleted': False, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a'} {{(pid=120437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 15 12:34:28.379047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.379517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.379942 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.380644 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.381111 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.381528 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.468194 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.multi_cell_list [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 15 12:34:28.557602 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-67967c85-7584-4c7b-b8b6-cd083c64dae8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.194231 Sep 15 12:34:28.558113 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 411/803] 10.222.0.15 () {58 vars in 1125 bytes} [Thu Sep 15 12:34:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:34:28.570019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:28.570644 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:28.576544 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.577063 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.577502 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.578218 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:28.578666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:28.579965 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:28.707933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:28.715561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-82a944b8-3987-4d98-84a9-f7aefde946ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1547 microversion: 2.1 time: 0.149343 Sep 15 12:34:28.716129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 393/804] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:28 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:30.258453 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce2c292f-42e9-4738-b20a-ba5cff010de2"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:30.260736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:30.267669 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:30.268146 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:30.268576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:30.269279 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:30.269723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:30.270143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:30.651555 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a49db109-a915-49e5-9ac7-568d60c83ab8 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396708 Sep 15 12:34:30.657794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 412/805] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 12:34:30 2022] POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:34:37.210042 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:37.210659 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:37.217288 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:37.217767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:37.218209 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:37.218894 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:37.219345 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:37.220371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:37.355503 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:37.363668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5fcfff84-cff4-4d1b-8945-ab9acc54b618 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1593 microversion: 2.1 time: 0.161710 Sep 15 12:34:37.364236 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 394/806] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:37 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:38.950657 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:39.022064 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-41ddeed6-76b8-4bed-9ea7-b80aab7c2a2c req-abf65b9d-dac8-4980-a453-3aa5c0df56a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:39.033054 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-41ddeed6-76b8-4bed-9ea7-b80aab7c2a2c req-abf65b9d-dac8-4980-a453-3aa5c0df56a1 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:39.033829 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-41ddeed6-76b8-4bed-9ea7-b80aab7c2a2c req-abf65b9d-dac8-4980-a453-3aa5c0df56a1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:39.034428 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-41ddeed6-76b8-4bed-9ea7-b80aab7c2a2c req-abf65b9d-dac8-4980-a453-3aa5c0df56a1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:39.046494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-41ddeed6-76b8-4bed-9ea7-b80aab7c2a2c req-abf65b9d-dac8-4980-a453-3aa5c0df56a1 service nova] Creating event network-changed:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:34:39.052188 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-41ddeed6-76b8-4bed-9ea7-b80aab7c2a2c req-abf65b9d-dac8-4980-a453-3aa5c0df56a1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107681 Sep 15 12:34:39.053383 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 413/807] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:34:40.024031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1409679511"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:40.024667 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:40.031383 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:40.031932 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:40.032405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:40.033129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:40.033715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:40.033989 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:40.162450 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.network.security_group_api [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Adding security group 79837d40-4811-4a0d-a346-fa11ed45ab95 to port c6d263ff-9e15-48e4-8b37-3df1381c1bc9 Sep 15 12:34:40.521336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-f4394cc4-e211-49d8-a224-ac57340c218f tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/action" status: 202 len: 0 microversion: 2.1 time: 0.501220 Sep 15 12:34:40.522589 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 395/808] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:34:40 2022] POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:34:40.531810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:34:40.533143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:34:40.539622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:40.540112 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:40.540555 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:40.541281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:40.541736 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:40.542341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:40.699874 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:34:40.702710 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:40.710273 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-330ae474-90ce-48fd-95ee-560b36b9b9ec tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1759 microversion: 2.1 time: 0.183114 Sep 15 12:34:40.710864 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 414/809] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:34:40 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:34:41.068928 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-74c23562-7d6e-4ac1-a439-da669b23ed47 req-84da00ca-432c-416d-bb27-328809fbbe04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:34:41.073828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:41.080268 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-74c23562-7d6e-4ac1-a439-da669b23ed47 req-84da00ca-432c-416d-bb27-328809fbbe04 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:34:41.080745 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-74c23562-7d6e-4ac1-a439-da669b23ed47 req-84da00ca-432c-416d-bb27-328809fbbe04 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:34:41.081197 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-74c23562-7d6e-4ac1-a439-da669b23ed47 req-84da00ca-432c-416d-bb27-328809fbbe04 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:34:41.085848 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=69 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:41.095402 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-74c23562-7d6e-4ac1-a439-da669b23ed47 req-84da00ca-432c-416d-bb27-328809fbbe04 service nova] Creating event network-changed:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:34:41.100537 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-74c23562-7d6e-4ac1-a439-da669b23ed47 req-84da00ca-432c-416d-bb27-328809fbbe04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036692 Sep 15 12:34:41.101349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 396/810] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:35:04.271471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:35:04.273748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:04.276960 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:04.284527 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:04.285033 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:04.285469 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:04.286161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:04.286618 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:04.287043 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:04.362003 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-359cca44-786b-495a-8c49-dcb412df7cdf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/action" status: 202 len: 0 microversion: 2.1 time: 0.094255 Sep 15 12:35:04.362621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 415/811] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:35:04 2022] POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:35:04.371640 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:04.372333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:04.375086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:04.381786 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:04.382272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:04.382707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:04.383392 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:04.383840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:04.384260 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:04.527839 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:04.536631 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ddbd5f6d-8c58-4077-ae94-e5f5010b59bc tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1751 microversion: 2.1 time: 0.169349 Sep 15 12:35:04.537237 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 397/812] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:04 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:05.560496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:05.561220 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:05.567841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:05.568321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:05.568767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:05.569456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:05.569907 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:05.570332 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:05.712195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:05.720440 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-02e0ddca-9cb5-4eef-8f04-cb6be1a295b2 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.164675 Sep 15 12:35:05.721382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 416/813] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:05 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:06.744034 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:06.744641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:06.751625 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:06.752097 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:06.752544 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:06.753223 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:06.753671 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:06.754087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:06.890338 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:06.898926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-88e38016-f756-4131-a0d4-cd4056545d11 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.158796 Sep 15 12:35:06.899517 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 398/814] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:06 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:07.921604 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:07.922145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:07.929030 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:07.929502 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:07.929935 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:07.930613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:07.931062 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:07.931482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:08.073229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:08.081568 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-232ae010-f246-4bb0-ad4e-7f3c663d61e6 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.163876 Sep 15 12:35:08.082127 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 417/815] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:07 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:09.104676 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:09.105310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:09.111621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:09.112095 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:09.112523 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:09.113224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:09.113668 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:09.114086 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:09.253127 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:09.261232 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-416db8ca-f092-425e-8bbb-796b9bd917fb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.160460 Sep 15 12:35:09.261814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 399/816] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:09 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:35:10.285697 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:10.286246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:10.292270 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:10.292747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:10.293212 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:10.293894 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:10.294343 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:10.294769 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:10.440990 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:10.449109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1328ab3d-8da4-4f36-ada6-bf586280ebcb tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.168057 Sep 15 12:35:10.449675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 418/817] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:10 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:11.473480 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:11.474092 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:11.480485 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:11.480947 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:11.481385 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:11.482064 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:11.482514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:11.482933 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:11.625142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:11.633206 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e663aefc-0e76-480c-874f-ba71d53f29a7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.164323 Sep 15 12:35:11.633774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 400/818] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:11 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:12.656919 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:12.657510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:12.663853 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:12.664326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:12.664771 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:12.665447 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:12.665889 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:12.666306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:12.804244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:12.812350 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5508f105-683a-4bf3-a5aa-31c1ea3dc011 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.159413 Sep 15 12:35:12.812943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 419/819] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:12 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:13.835647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:13.836258 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:13.842666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:13.843145 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:13.843577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:13.844257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:13.844705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:13.845152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:13.985399 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:13.994040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3dbd1262-91de-45c4-8cf0-df5cd1aba204 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.162248 Sep 15 12:35:13.994604 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 401/820] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:13 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:15.018138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:15.018776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:15.025847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:15.026322 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:15.026757 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:15.027438 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:15.027881 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:15.028307 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:15.169277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:15.177737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ac66b7bd-dfee-4346-8bdf-a53c0600d7a3 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.164089 Sep 15 12:35:15.178320 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 420/821] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:15 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:16.200778 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:16.201443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:16.209813 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:16.210295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:16.210737 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:16.211455 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:16.211910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:16.212332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:16.352845 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:16.361266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3a6a56cc-1fc6-435d-859c-fc4d99fc1851 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1756 microversion: 2.1 time: 0.164231 Sep 15 12:35:16.361841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 402/822] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:16 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:17.384313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:17.384881 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:17.391217 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:17.391701 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:17.392133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:17.392838 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:17.393289 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:17.393714 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:17.531236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:17.539870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-50a61d13-f852-4822-8732-6b76b76216f9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1759 microversion: 2.1 time: 0.159499 Sep 15 12:35:17.540425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 421/823] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:17 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:49.869957 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1409679511"}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:35:49.870526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:49.873338 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=12 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:49.874154 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=37 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:49.879709 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:49.880188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:49.880631 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:49.881327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:49.881780 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:49.882201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:50.005504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.network.security_group_api [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Removing security group 79837d40-4811-4a0d-a346-fa11ed45ab95 from port c6d263ff-9e15-48e4-8b37-3df1381c1bc9 Sep 15 12:35:50.516874 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4e189485-47c3-45c4-9f96-1911d80cfab7 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/action" status: 202 len: 0 microversion: 2.1 time: 0.650945 Sep 15 12:35:50.518075 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 403/824] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:35:49 2022] POST /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:35:50.527278 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-563105a2-aa14-454c-9e4d-35b60751ffba req-80ef84b7-f3f1-4c2a-9e21-9907ae9c1272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:35:50.538820 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=14 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:50.539794 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:50.542839 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-563105a2-aa14-454c-9e4d-35b60751ffba req-80ef84b7-f3f1-4c2a-9e21-9907ae9c1272 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:50.544400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-563105a2-aa14-454c-9e4d-35b60751ffba req-80ef84b7-f3f1-4c2a-9e21-9907ae9c1272 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:50.545123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-563105a2-aa14-454c-9e4d-35b60751ffba req-80ef84b7-f3f1-4c2a-9e21-9907ae9c1272 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:50.562648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-563105a2-aa14-454c-9e4d-35b60751ffba req-80ef84b7-f3f1-4c2a-9e21-9907ae9c1272 service nova] Creating event network-changed:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:35:50.571925 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-563105a2-aa14-454c-9e4d-35b60751ffba req-80ef84b7-f3f1-4c2a-9e21-9907ae9c1272 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049802 Sep 15 12:35:50.573458 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 422/825] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:35:51.630980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:51.631539 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:51.637360 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:51.637837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:51.638270 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:51.638948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:51.639391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:51.639807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:51.723200 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.objects.instance [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lazy-loading 'services' on Instance uuid e8f5414e-3890-4a27-8e87-87d1fab826df {{(pid=120436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:35:51.796397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e38451ad-0a24-45b9-8739-183d66821810 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments/ce2c292f-42e9-4738-b20a-ba5cff010de2" status: 202 len: 0 microversion: 2.1 time: 0.170593 Sep 15 12:35:51.797030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 404/826] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:35:51 2022] DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments/ce2c292f-42e9-4738-b20a-ba5cff010de2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:35:51.807920 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:51.810261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:51.816674 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:51.817213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:51.817647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:51.818344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:51.818786 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:51.819319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:51.853053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1027493a-cd2c-43b3-8b03-0f827c29df2e tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050509 Sep 15 12:35:51.853943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 423/827] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:35:51 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:35:52.590719 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-2cf84707-1039-43ec-8be9-54d68c3d30bf req-54f78985-10f6-4005-87e4-dbdfa8a5c0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:35:52.600709 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-2cf84707-1039-43ec-8be9-54d68c3d30bf req-54f78985-10f6-4005-87e4-dbdfa8a5c0b6 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:52.601219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-2cf84707-1039-43ec-8be9-54d68c3d30bf req-54f78985-10f6-4005-87e4-dbdfa8a5c0b6 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:52.601652 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-2cf84707-1039-43ec-8be9-54d68c3d30bf req-54f78985-10f6-4005-87e4-dbdfa8a5c0b6 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:52.613609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-2cf84707-1039-43ec-8be9-54d68c3d30bf req-54f78985-10f6-4005-87e4-dbdfa8a5c0b6 service nova] Creating event network-changed:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:35:52.621054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-2cf84707-1039-43ec-8be9-54d68c3d30bf req-54f78985-10f6-4005-87e4-dbdfa8a5c0b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034232 Sep 15 12:35:52.621663 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 405/828] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:35:52.866138 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:52.868269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:52.874572 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:52.875053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:52.875487 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:52.876223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:52.877240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:52.877677 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:52.906232 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d8f4d0e9-a7c0-4870-a184-c0c98a50e44d tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044026 Sep 15 12:35:52.906810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 424/829] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 12:35:52 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 12:35:52.917800 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:52.918377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:52.925547 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:52.926024 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:52.926452 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:52.927125 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:52.927566 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:52.927980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:53.004954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] HTTP exception thrown: Instance e8f5414e-3890-4a27-8e87-87d1fab826df is not attached to volume ce2c292f-42e9-4738-b20a-ba5cff010de2 Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Request method failure captured: Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments/ce2c292f-42e9-4738-b20a-ba5cff010de2 HTTP/1.1 Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxu0tNHiANVAlLcgN3O_1uAJdVZ5acZyKR7xASpJyF-fAQyCyYaEBrU_F1S-BAsD05jqIMdWFFy0E9b22Srub6aW0AOShmjtNxCcyy-rKsTF1rkYrrcpJZWeZEEEBt-Bhce7aiY2U0xim4pm4V70zeGvuFDIe8jJ5ym3TDGLs1-xIaM Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 84b799b1cfab4245bf9fbfce0faf036a Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestMinimumBasicScenario-1423653976 Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:35:53.007297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestMinimumBasicScenario-1423653976 Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 84b799b1cfab4245bf9fbfce0faf036a Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1423653976 Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestMinimumBasicScenario-1423653976-project Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 08bd9f54467341afacba19215b78bf59 Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestMinimumBasicScenario-1423653976-project Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:35:53.009038 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance e8f5414e-3890-4a27-8e87-87d1fab826df is not attached to volume ce2c292f-42e9-4738-b20a-ba5cff010de2 Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'server_id': 'e8f5414e-3890-4a27-8e87-87d1fab826df', 'id': 'ce2c292f-42e9-4738-b20a-ba5cff010de2'} Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ce2c292f-42e9-4738-b20a-ba5cff010de2. Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:35:53.013122 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f5414e-3890-4a27-8e87-87d1fab826df is not attached to volume ce2c292f-42e9-4738-b20a-ba5cff010de2 Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f5414e-3890-4a27-8e87-87d1fab826df is not attached to volume ce2c292f-42e9-4738-b20a-ba5cff010de2 Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:53.014602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Returning 404 to user: Instance e8f5414e-3890-4a27-8e87-87d1fab826df is not attached to volume ce2c292f-42e9-4738-b20a-ba5cff010de2 {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:35:53.016257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-cd53ba54-d77e-4d26-8266-81e5997c7948 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments/ce2c292f-42e9-4738-b20a-ba5cff010de2" status: 404 len: 154 microversion: 2.1 time: 0.095194 Sep 15 12:35:53.016257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 406/830] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 12:35:52 2022] DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df/os-volume_attachments/ce2c292f-42e9-4738-b20a-ba5cff010de2 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:35:54.150176 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:54.150668 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:54.156973 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:54.157449 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:54.157927 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:54.158610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:54.159051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:54.159470 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:54.183181 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:35:54.257769 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-632e9825-ee17-4ba8-8369-acc04cb481bf tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 204 len: 0 microversion: 2.1 time: 0.111014 Sep 15 12:35:54.258261 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 425/831] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:35:54 2022] DELETE /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:35:54.266569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:54.267836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:54.273947 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:54.274426 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:54.274864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:54.275551 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:54.276004 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:54.276430 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:54.402755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:54.410377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-13c200b9-d4db-4b21-a3a9-ddfb8dd14d59 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1553 microversion: 2.1 time: 0.147691 Sep 15 12:35:54.410948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 407/832] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:54 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:55.434167 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:55.434877 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:55.441243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:55.441727 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:55.442163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:55.442849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:55.443313 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:55.443717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:55.570924 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:55.578543 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-939b92d7-5b3c-436a-bef3-5bfa4b73b4aa tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1553 microversion: 2.1 time: 0.148620 Sep 15 12:35:55.579109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 426/833] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:55 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:56.602347 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:56.603710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:56.617822 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:56.618311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:56.618745 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:56.619443 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:56.619891 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:56.620319 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:56.692387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08bd9f54467341afacba19215b78bf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b799b1cfab4245bf9fbfce0faf036a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:35:56.703056 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-1a2695c0-398b-4606-8afc-99e7d3df9e14 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 200 len: 1511 microversion: 2.1 time: 0.104386 Sep 15 12:35:56.717393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 408/834] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:56 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:35:56.739358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-e9972e20-5149-42e3-be15-129eddf26290 req-ef4b4cf3-212b-4cc8-a49e-a2a8c353a73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f5414e-3890-4a27-8e87-87d1fab826df", "name": "network-vif-deleted", "tag": "c6d263ff-9e15-48e4-8b37-3df1381c1bc9"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:35:56.748724 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-e9972e20-5149-42e3-be15-129eddf26290 req-ef4b4cf3-212b-4cc8-a49e-a2a8c353a73b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:56.749256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-e9972e20-5149-42e3-be15-129eddf26290 req-ef4b4cf3-212b-4cc8-a49e-a2a8c353a73b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:56.749887 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-e9972e20-5149-42e3-be15-129eddf26290 req-ef4b4cf3-212b-4cc8-a49e-a2a8c353a73b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:56.761678 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-e9972e20-5149-42e3-be15-129eddf26290 req-ef4b4cf3-212b-4cc8-a49e-a2a8c353a73b service nova] Creating event network-vif-deleted:c6d263ff-9e15-48e4-8b37-3df1381c1bc9 for instance e8f5414e-3890-4a27-8e87-87d1fab826df on hv-cinder-85083 Sep 15 12:35:56.766886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-e9972e20-5149-42e3-be15-129eddf26290 req-ef4b4cf3-212b-4cc8-a49e-a2a8c353a73b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099050 Sep 15 12:35:56.767631 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 427/835] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:35:57.735138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:57.735751 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] [instance: e8f5414e-3890-4a27-8e87-87d1fab826df] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:35:57.742755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:57.743233 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:57.743665 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:57.744348 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:35:57.744816 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:35:57.745240 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:35:57.758299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] HTTP exception thrown: Instance e8f5414e-3890-4a27-8e87-87d1fab826df could not be found. Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Request method failure captured: Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df HTTP/1.1 Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxu0tNHiANVAlLcgN3O_1uAJdVZ5acZyKR7xASpJyF-fAQyCyYaEBrU_F1S-BAsD05jqIMdWFFy0E9b22Srub6aW0AOShmjtNxCcyy-rKsTF1rkYrrcpJZWeZEEEBt-Bhce7aiY2U0xim4pm4V70zeGvuFDIe8jJ5ym3TDGLs1-xIaM Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 84b799b1cfab4245bf9fbfce0faf036a Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestMinimumBasicScenario-1423653976 Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:35:57.759798 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/84b799b1cfab4245bf9fbfce0faf036a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestMinimumBasicScenario-1423653976 Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 84b799b1cfab4245bf9fbfce0faf036a Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1423653976 Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestMinimumBasicScenario-1423653976-project Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 08bd9f54467341afacba19215b78bf59 Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestMinimumBasicScenario-1423653976-project Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance e8f5414e-3890-4a27-8e87-87d1fab826df could not be found. Sep 15 12:35:57.761148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'e8f5414e-3890-4a27-8e87-87d1fab826df'} Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f5414e-3890-4a27-8e87-87d1fab826df could not be found. Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:35:57.761926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f5414e-3890-4a27-8e87-87d1fab826df could not be found. Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f5414e-3890-4a27-8e87-87d1fab826df could not be found. Sep 15 12:35:57.763371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:35:57.764787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Returning 404 to user: Instance e8f5414e-3890-4a27-8e87-87d1fab826df could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:35:57.764787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e5ccb3f6-3faa-4e87-bb8d-4c6124beabf9 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df" status: 404 len: 111 microversion: 2.1 time: 0.029854 Sep 15 12:35:57.764787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 409/836] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:35:57 2022] GET /compute/v2.1/servers/e8f5414e-3890-4a27-8e87-87d1fab826df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:35:57.770247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3a100cc6-6ec2-4d8d-9807-127878475236 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] Calling method '.version_select at 0x7ff0d04033a0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:35:57.789421 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3a100cc6-6ec2-4d8d-9807-127878475236 tempest-TestMinimumBasicScenario-1423653976 tempest-TestMinimumBasicScenario-1423653976-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-938883156" status: 202 len: 0 microversion: 2.1 time: 0.023207 Sep 15 12:35:57.789974 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 428/837] 10.222.0.15 () {58 vars in 1269 bytes} [Thu Sep 15 12:35:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-938883156 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 12:36:14.873519 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=14 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:14.874298 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:15.052975 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-79db7dd1-7c72-4c30-8696-61546092b3b5 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Action: 'create', calling method: .version_select at 0x7ff0d04499d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1324124335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGazmOS4IDQR2SPHqyU4eCegDttERY0orkvMObhrgHJIqYWIB23I3ZwkqhpgnDvjcY2IaJqSMzXZkCJr+V4+6svqupMWuiDsiDW4L7NxJymJoOMdo3fei9oyxHCtdkB33Q=="}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:36:15.069205 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-79db7dd1-7c72-4c30-8696-61546092b3b5 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Getting quotas for project d62b434017e447f88e0a1cf275ba27bb. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:36:15.073360 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-79db7dd1-7c72-4c30-8696-61546092b3b5 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Getting quotas for user d36ce80b9d3e4810be863d54a8bb7865 and project d62b434017e447f88e0a1cf275ba27bb. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:36:15.096275 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-79db7dd1-7c72-4c30-8696-61546092b3b5 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.228369 Sep 15 12:36:15.097247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 410/838] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:36:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:36:32.333256 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:32.333995 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:32.338770 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2096746626", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1324124335", "security_groups": [{"name": "tempest-secgroup-smoke-1652347524"}], "networks": [{"uuid": "6ddf39de-b93f-4351-ada5-e42514b40419"}], "block_device_mapping_v2": [{"uuid": "a07dc0d8-6947-416d-a95e-0e089237ee7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:36:32.452466 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] validate_networks() for [('6ddf39de-b93f-4351-ada5-e42514b40419', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:36:32.912823 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:36:32.913252 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:36:32.913728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:36:32.914140 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:36:32.914551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:36:32.923228 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:32.923704 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:32.924161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:32.924892 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:32.925344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:32.925764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:32.943316 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Getting quotas for project d62b434017e447f88e0a1cf275ba27bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:36:32.947337 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Getting quotas for user d36ce80b9d3e4810be863d54a8bb7865 and project d62b434017e447f88e0a1cf275ba27bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:36:33.003312 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:36:33.006102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a07dc0d8-6947-416d-a95e-0e089237ee7a',volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:36:33.134328 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e86fa2a5-da54-43cd-ac88-1dd1873eae3b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803504 Sep 15 12:36:33.134971 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 429/839] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:36:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 12:36:33.144066 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:33.144826 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:33.149690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-ea25ee1b-9df7-4b94-9bad-30cfde24e71a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:33.150310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-ea25ee1b-9df7-4b94-9bad-30cfde24e71a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:33.206478 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-ea25ee1b-9df7-4b94-9bad-30cfde24e71a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:33.215291 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-ea25ee1b-9df7-4b94-9bad-30cfde24e71a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1089 microversion: 2.1 time: 0.073084 Sep 15 12:36:33.228774 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 411/840] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:33 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:34.237224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:34.237847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:34.245847 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:34.246326 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:34.246765 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:34.247457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:34.247909 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:34.248332 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:34.315177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:34.323642 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-35048709-de58-465f-8403-59a0e2641177 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1187 microversion: 2.1 time: 0.090396 Sep 15 12:36:34.324529 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 430/841] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:34 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:35.347263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:35.347795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:35.354699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:35.355185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:35.355622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:35.356316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:35.356788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:35.357220 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:35.491912 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:35.503540 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-10aa3392-d302-4eba-b102-29c342658e5d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.160196 Sep 15 12:36:35.509424 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 412/842] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:35 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:35.694607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-b14929dc-eeee-406f-864a-56c8b275e642 req-ab3a4643-6f57-4e35-9bbc-a022fae397b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:36:35.718719 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-b14929dc-eeee-406f-864a-56c8b275e642 req-ab3a4643-6f57-4e35-9bbc-a022fae397b6 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:35.719207 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-b14929dc-eeee-406f-864a-56c8b275e642 req-ab3a4643-6f57-4e35-9bbc-a022fae397b6 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:35.719690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-b14929dc-eeee-406f-864a-56c8b275e642 req-ab3a4643-6f57-4e35-9bbc-a022fae397b6 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:35.740540 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-b14929dc-eeee-406f-864a-56c8b275e642 req-ab3a4643-6f57-4e35-9bbc-a022fae397b6 service nova] Creating event network-changed:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:36:35.746739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-b14929dc-eeee-406f-864a-56c8b275e642 req-ab3a4643-6f57-4e35-9bbc-a022fae397b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055867 Sep 15 12:36:35.747762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 431/843] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:36:36.526230 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:36.526839 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:36.533189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:36.533663 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:36.534094 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:36.534766 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:36.535226 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:36.535624 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:36.664874 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:36.672690 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-619d8fbe-a50f-47af-9069-968427ee5be6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.150277 Sep 15 12:36:36.673391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 413/844] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:36 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:37.696709 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:37.697424 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:37.703607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:37.704140 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:37.704743 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:37.705685 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:37.706165 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:37.706666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:37.839747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:37.847327 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0f488b0f-0260-4b6b-b86e-da3df404b1ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.155274 Sep 15 12:36:37.847886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 432/845] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:37 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:38.870453 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:38.871055 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:38.877412 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:38.877889 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:38.878316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:38.878990 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:38.879439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:38.882147 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:39.010081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:39.017661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6ee273f1-f7f5-45be-b4b0-0f58932101a3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.150996 Sep 15 12:36:39.018222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 414/846] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:38 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:40.040133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:40.040795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:40.046651 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:40.047123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:40.047549 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:40.048225 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:40.048672 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:40.049118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:40.177473 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:40.184992 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-786b2b99-5be8-4b79-9d2b-1c3202ed5bef tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.149442 Sep 15 12:36:40.185553 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 433/847] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:40 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:41.207299 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:41.208175 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:41.214522 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:41.214993 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:41.215420 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:41.216087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:41.216531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:41.216978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:41.342928 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:41.350881 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-bea9daef-ad00-4023-90d5-701e7de80fe7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.147483 Sep 15 12:36:41.351439 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 415/848] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:41 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:42.373554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:42.374196 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:42.381742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:42.382244 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:42.382657 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:42.383341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:42.383790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:42.384210 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:42.515635 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:42.523398 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-a602f04a-43c3-4693-9dd6-995cc47f63dc tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.153885 Sep 15 12:36:42.523975 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 434/849] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:42 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:43.546054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:43.546593 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:43.549333 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:43.554661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:43.555133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:43.555562 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:43.556241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:43.556686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:43.557124 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:43.691403 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:43.700131 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9d601b29-26c1-4c6d-931b-2a86cb63941c tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.157958 Sep 15 12:36:43.700707 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 416/850] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:43 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:44.604263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:44.605310 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:44.665183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-6f7220ca-8f71-497d-954a-0d4d9bf840e1 req-f0b3ea21-eac8-4b25-bf45-760c25c980b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "name": "network-vif-plugged", "status": "completed", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:36:44.674546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6f7220ca-8f71-497d-954a-0d4d9bf840e1 req-f0b3ea21-eac8-4b25-bf45-760c25c980b9 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:44.675023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6f7220ca-8f71-497d-954a-0d4d9bf840e1 req-f0b3ea21-eac8-4b25-bf45-760c25c980b9 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:44.675511 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-6f7220ca-8f71-497d-954a-0d4d9bf840e1 req-f0b3ea21-eac8-4b25-bf45-760c25c980b9 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:44.687296 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-6f7220ca-8f71-497d-954a-0d4d9bf840e1 req-f0b3ea21-eac8-4b25-bf45-760c25c980b9 service nova] Creating event network-vif-plugged:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:36:44.692666 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-6f7220ca-8f71-497d-954a-0d4d9bf840e1 req-f0b3ea21-eac8-4b25-bf45-760c25c980b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092846 Sep 15 12:36:44.693291 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 435/851] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:36:44.724222 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:44.724748 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:44.731119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:44.731594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:44.732028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:44.732705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:44.733174 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:44.733589 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:44.868596 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:44.877256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a65ffccc-6570-4286-babb-696a39975208 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.157634 Sep 15 12:36:44.878185 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 417/852] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:44 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:45.901728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:45.902357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:45.908514 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:45.909033 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:45.909472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:45.910152 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:45.910605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:45.911539 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:46.045963 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:46.053626 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5e5ae358-88af-453f-a900-2cc14e9496d9 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1261 microversion: 2.1 time: 0.156752 Sep 15 12:36:46.054195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 436/853] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:45 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:47.075292 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:47.075896 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:47.082329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:47.083184 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:47.083776 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:47.084768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:47.085401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:47.086000 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:47.215799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:47.224001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-070a17c6-15ac-4637-b6a2-e40c1861e548 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1445 microversion: 2.1 time: 0.152065 Sep 15 12:36:47.224561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 418/854] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:47 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:47.245852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:36:47.246399 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:36:47.252735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:47.253248 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:47.253681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:47.254360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:47.254839 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:47.255263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:47.384022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:36:47.391737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-98a885b3-a5b3-4401-852e-374991123d37 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1445 microversion: 2.1 time: 0.149734 Sep 15 12:36:47.392304 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 437/855] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:36:47 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:36:49.182761 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-d362f885-724a-4f08-b4cf-f297e9658349 req-b3e987a9-cb77-4a93-9053-8dfc381ae8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:36:49.193538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d362f885-724a-4f08-b4cf-f297e9658349 req-b3e987a9-cb77-4a93-9053-8dfc381ae8f3 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:36:49.194229 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d362f885-724a-4f08-b4cf-f297e9658349 req-b3e987a9-cb77-4a93-9053-8dfc381ae8f3 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:36:49.194856 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-d362f885-724a-4f08-b4cf-f297e9658349 req-b3e987a9-cb77-4a93-9053-8dfc381ae8f3 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:36:49.206195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-d362f885-724a-4f08-b4cf-f297e9658349 req-b3e987a9-cb77-4a93-9053-8dfc381ae8f3 service nova] Creating event network-changed:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:36:49.211732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-d362f885-724a-4f08-b4cf-f297e9658349 req-b3e987a9-cb77-4a93-9053-8dfc381ae8f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032774 Sep 15 12:36:49.212319 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 419/856] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:38:46.528213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e77fc1a6-c3f6-4ea9-8d37-e56f1f7c4191] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 12:38:46.529336 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:38:46.529495 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Thu Sep 15 12:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3/action (ip 10.222.0.15) !!! Sep 15 12:38:46.530462 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:38:46.530613 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Thu Sep 15 12:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3/action (ip 10.222.0.15) !!! Sep 15 12:38:46.531510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:38:46.532242 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=42 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:38:46.538915 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:38:46.539455 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:46.551170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:46.552434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:46.552913 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:46.553634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:46.554168 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:46.554704 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:46.579441 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lazy-loading 'flavor' on Instance uuid 53865302-99c2-44ce-92cd-9697cddccec3 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:38:46.648964 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-cb01060c-a0ec-455b-a316-299594726a8f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "POST /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3/action" status: 202 len: 0 microversion: 2.1 time: 0.123388 Sep 15 12:38:46.649544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 438/857] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:38:46 2022] POST /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:38:46.655898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76a84b38-a861-468c-ba66-68b6866cc13d] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 12:38:46.657007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:38:46.657135 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Thu Sep 15 12:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 (ip 10.222.0.15) !!! Sep 15 12:38:46.658713 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:38:46.658852 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Thu Sep 15 12:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 (ip 10.222.0.15) !!! Sep 15 12:38:46.659795 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=20 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:38:46.660514 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=44 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:38:46.665280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:46.665971 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:46.678276 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:46.678935 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:46.679428 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:46.680123 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:46.680571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:46.681019 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:46.816661 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:46.824973 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d0b2add1-4e86-490a-9430-72d425f8f68e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.170914 Sep 15 12:38:46.825532 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 420/858] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:46 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:47.848606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:47.849330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:47.856438 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:47.856959 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:47.857392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:47.858066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:47.858513 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:47.858930 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:47.865508 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO oslo.messaging._drivers.impl_rabbit [-] [e77fc1a6-c3f6-4ea9-8d37-e56f1f7c4191] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51334. Sep 15 12:38:47.990234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:47.997952 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8d6102de-7d45-488d-94db-542c328f33da tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.154315 Sep 15 12:38:47.998517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 439/859] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:47 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:49.020978 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:49.021588 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:49.034228 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] [76a84b38-a861-468c-ba66-68b6866cc13d] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51338. Sep 15 12:38:49.036290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:49.036803 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:49.037245 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:49.037944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:49.038393 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:49.038903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:49.189486 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:49.197799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4fa1b801-e1bf-41d2-b144-6a1d63b8d86d tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.180728 Sep 15 12:38:49.198367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 421/860] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:49 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:50.221429 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:50.222045 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:50.229246 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:50.229732 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:50.230166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:50.230854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:50.231298 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:50.231721 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:50.364662 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:50.372319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6244015f-88c7-490a-8932-9af220c10d9b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.154794 Sep 15 12:38:50.372908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 440/861] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:50 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:51.395952 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:51.396499 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:51.402918 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:51.403397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:51.403828 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:51.404509 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:51.404986 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:51.405409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:51.539074 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:51.546759 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-41953a75-52ff-4ca9-99be-bda0f155d736 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.155382 Sep 15 12:38:51.547324 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 422/862] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:51 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:52.569722 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:52.570334 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:52.576722 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:52.577223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:52.577649 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:52.578322 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:52.578765 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:52.579181 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:52.705163 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:52.713064 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-efe681ee-80e2-44c8-84c0-20c731e14959 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.147420 Sep 15 12:38:52.713640 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 441/863] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:52 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:53.736187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:53.736839 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:53.743641 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:53.744111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:53.744538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:53.745306 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:53.745754 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:53.746167 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:53.874949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:53.883210 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-09474b09-5c23-4f21-b3ae-23d7a8cd5b8a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.150840 Sep 15 12:38:53.883768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 423/864] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:53 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:54.905235 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:54.905928 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:54.912943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:54.913435 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:54.913878 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:54.914567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:54.915022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:54.915449 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:55.056240 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:55.063996 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3ef6bddc-785b-499f-bbe3-27d123d2b2a6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.162799 Sep 15 12:38:55.064578 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 442/865] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:54 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:56.086999 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:56.087609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:56.094088 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:56.094569 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:56.095003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:56.095686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:56.096132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:56.096553 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:56.225473 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:56.233135 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-44824427-8868-484e-b351-241c6af8d89a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.150084 Sep 15 12:38:56.234376 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 424/866] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:56 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:57.258087 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:57.258715 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:57.265818 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:57.266305 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:57.266743 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:57.267434 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:57.267891 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:57.268321 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:57.401392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:57.410184 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d1414d65-1af6-4f9f-96a0-14a2e7cb771b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.156651 Sep 15 12:38:57.410967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 443/867] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:57 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:58.434603 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:58.435061 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:58.442778 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:58.443264 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:58.443697 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:58.444386 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:58.444908 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:58.445336 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:58.572963 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:58.581068 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b2c52a22-030a-4cfd-8e85-084ef7fe1594 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.150653 Sep 15 12:38:58.581636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 425/868] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:58 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:38:59.605349 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:38:59.606005 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:38:59.614825 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:59.615412 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:59.616096 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:59.617092 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:38:59.617776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:38:59.618170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:38:59.755393 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:38:59.763852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-39525492-2986-4fa1-9978-f2609975d720 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.162372 Sep 15 12:38:59.764419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 444/869] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:38:59 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:00.787586 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:00.788201 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:00.794686 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:00.795161 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:00.795594 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:00.796272 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:00.796725 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:00.797188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:00.926883 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:00.934504 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-a2702a08-7377-48ac-9d76-22545184004b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1511 microversion: 2.1 time: 0.151336 Sep 15 12:39:00.935081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 426/870] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:00 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:39:00.956448 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:39:00.957075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:00.963850 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:00.964329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:00.964774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:00.965500 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:00.965965 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:00.966373 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:00.996347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120437) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 12:39:01.062810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-87a829c1-2383-42a5-b6fc-027f1ab9462f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "POST /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3/action" status: 202 len: 0 microversion: 2.1 time: 0.110149 Sep 15 12:39:01.063357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 445/871] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 12:39:00 2022] POST /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 12:39:01.071279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:01.072524 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:01.078386 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:01.078865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:01.079294 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:01.079981 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:01.080429 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:01.080876 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:01.259921 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:01.269357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c2d77a0c-e3e5-4f63-a869-7a91b8e39e38 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1519 microversion: 2.1 time: 0.201842 Sep 15 12:39:01.283148 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 427/872] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:01 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:02.295360 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:02.295939 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:02.302262 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:02.302750 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:02.303190 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:02.303891 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:02.304549 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:02.305016 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:02.438695 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:02.447263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7053afec-a56d-42de-8307-672fd91d7d2f tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1521 microversion: 2.1 time: 0.157288 Sep 15 12:39:02.448044 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 446/873] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:02 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:03.106366 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-5a3ef81e-dbc4-4e8d-97e7-f7560398a65e req-5fa7f90b-b7ae-4bc1-9f00-7e40123058e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "name": "network-vif-unplugged", "status": "completed", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:39:03.120732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5a3ef81e-dbc4-4e8d-97e7-f7560398a65e req-5fa7f90b-b7ae-4bc1-9f00-7e40123058e4 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:03.121372 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5a3ef81e-dbc4-4e8d-97e7-f7560398a65e req-5fa7f90b-b7ae-4bc1-9f00-7e40123058e4 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:03.121910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-5a3ef81e-dbc4-4e8d-97e7-f7560398a65e req-5fa7f90b-b7ae-4bc1-9f00-7e40123058e4 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:03.134164 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-5a3ef81e-dbc4-4e8d-97e7-f7560398a65e req-5fa7f90b-b7ae-4bc1-9f00-7e40123058e4 service nova] Creating event network-vif-unplugged:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:39:03.139358 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-5a3ef81e-dbc4-4e8d-97e7-f7560398a65e req-5fa7f90b-b7ae-4bc1-9f00-7e40123058e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037144 Sep 15 12:39:03.140125 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 428/874] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:39:03.471372 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:03.471987 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:03.478485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:03.478967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:03.479401 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:03.480120 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:03.480568 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:03.481019 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:03.615295 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:03.623044 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d3b8b202-dc9a-43da-a2df-3a05f72ee33b tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.155613 Sep 15 12:39:03.623609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 447/875] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:03 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:04.646575 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:04.647280 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:04.653469 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:04.653944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:04.654380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:04.655068 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:04.655510 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:04.655930 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:04.788914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:04.796727 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-590b98ea-2851-4ef4-8f52-fa3822998b47 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.154835 Sep 15 12:39:04.797320 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 429/876] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:04 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:05.819884 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:05.820471 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:05.826861 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:05.827338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:05.827767 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:05.828440 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:05.828913 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:05.829334 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:05.958739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:05.966752 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e19c5097-45fa-48c4-b8e5-4b3b7637ab87 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.151270 Sep 15 12:39:05.967320 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 448/877] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:05 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:06.990712 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:06.991326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:06.997758 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:06.998234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:06.998666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:06.999342 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:06.999788 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:07.000213 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:07.133207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:07.140866 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2f7176aa-e23c-4c57-a747-b3a635686515 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.154516 Sep 15 12:39:07.141435 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 430/878] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:06 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:08.164014 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:08.164597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:08.171459 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:08.171933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:08.172362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:08.173066 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:08.173518 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:08.173931 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:08.302484 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:08.310492 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-35efa53b-e641-4b25-bb08-61beaa97dda3 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.150906 Sep 15 12:39:08.311056 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 449/879] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:08 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:09.333513 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:09.334087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:09.341692 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:09.342170 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:09.342606 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:09.343297 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:09.343749 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:09.344173 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:09.480954 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:09.489241 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3defa2a0-6d24-4239-9280-bf828c87ef22 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.159279 Sep 15 12:39:09.489808 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 431/880] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:09 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:10.512468 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:10.513095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:10.519641 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:10.520680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:10.521140 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:10.521841 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:10.522287 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:10.522702 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:10.656101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:10.663844 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3bc9bc5b-f86d-4a10-959f-ec58ea28c57e tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1577 microversion: 2.1 time: 0.155311 Sep 15 12:39:10.664403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 450/881] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:10 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:11.685711 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:39:11.686322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:39:11.693203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:11.693809 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:11.694266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:11.695433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:11.696187 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:11.696694 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:11.882988 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:39:11.890738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-528b89dc-262c-48fa-9af0-8aba81a66b25 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1564 microversion: 2.1 time: 0.208972 Sep 15 12:39:11.891307 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 432/882] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:39:11 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1564 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:39:13.181444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-06e675cc-a340-4ba8-93aa-990e0852f405 req-554b12ad-16c2-4805-bfec-beeab4eb3999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "name": "network-vif-plugged", "status": "completed", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:39:13.192956 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-06e675cc-a340-4ba8-93aa-990e0852f405 req-554b12ad-16c2-4805-bfec-beeab4eb3999 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:39:13.193680 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-06e675cc-a340-4ba8-93aa-990e0852f405 req-554b12ad-16c2-4805-bfec-beeab4eb3999 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:39:13.194123 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-06e675cc-a340-4ba8-93aa-990e0852f405 req-554b12ad-16c2-4805-bfec-beeab4eb3999 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:39:13.205236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-06e675cc-a340-4ba8-93aa-990e0852f405 req-554b12ad-16c2-4805-bfec-beeab4eb3999 service nova] Creating event network-vif-plugged:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:39:13.211075 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-06e675cc-a340-4ba8-93aa-990e0852f405 req-554b12ad-16c2-4805-bfec-beeab4eb3999 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033406 Sep 15 12:39:13.211872 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 451/883] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:40:28.538073 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:28.539196 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:40:28.543531 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=26 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:28.544289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=74 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:28.546219 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-aa5b4250-bfb5-4f4f-9216-845ca0b26795 req-65b4ebbf-666b-47b1-b89d-d8476f256b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:40:28.551131 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:28.552013 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:28.552203 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:28.552966 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:28.553416 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:28.553837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:28.561008 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:28.562161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:28.566821 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-aa5b4250-bfb5-4f4f-9216-845ca0b26795 req-65b4ebbf-666b-47b1-b89d-d8476f256b73 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:28.567526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-aa5b4250-bfb5-4f4f-9216-845ca0b26795 req-65b4ebbf-666b-47b1-b89d-d8476f256b73 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:28.568222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-aa5b4250-bfb5-4f4f-9216-845ca0b26795 req-65b4ebbf-666b-47b1-b89d-d8476f256b73 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:28.586295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Going to try to terminate instance {{(pid=120436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:40:28.587182 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-aa5b4250-bfb5-4f4f-9216-845ca0b26795 req-65b4ebbf-666b-47b1-b89d-d8476f256b73 service nova] Creating event network-changed:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:40:28.599436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-aa5b4250-bfb5-4f4f-9216-845ca0b26795 req-65b4ebbf-666b-47b1-b89d-d8476f256b73 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061145 Sep 15 12:40:28.601319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 452/884] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:40:28.692658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-849e8d88-6a7a-43a5-aec7-072fdb7c15f7 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 204 len: 0 microversion: 2.1 time: 0.160077 Sep 15 12:40:28.693561 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 433/885] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:40:28 2022] DELETE /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:40:28.703444 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:28.704143 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:40:28.712391 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:28.712904 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:28.713390 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:28.714047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:28.714475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:28.714895 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:28.905335 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:40:28.914461 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b8a6a8ee-b46a-4a08-b4fd-572b5d297cf6 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.215897 Sep 15 12:40:28.915041 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 453/886] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:40:28 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:40:29.938432 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:29.939351 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:40:29.945793 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:29.946278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:29.946715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:29.947409 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:29.947865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:29.948289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:30.081886 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:40:30.089743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2f3a6dbc-e28c-453d-8570-6e1cfee09a73 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1570 microversion: 2.1 time: 0.155633 Sep 15 12:40:30.090307 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 434/887] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:40:29 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:40:31.113766 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:31.114440 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:40:31.121417 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:31.121907 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:31.122341 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:31.123028 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:31.123480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:31.123902 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:31.259648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:40:31.267698 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e837eb75-bc8d-49dd-85fb-bb215c21c8b1 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1451 microversion: 2.1 time: 0.158630 Sep 15 12:40:31.268277 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 454/888] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:40:31 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:40:31.447212 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-2e35fbf5-5e1c-40c6-a000-3b9ec01a21d6 req-78b041a3-8792-4982-8637-0035d4e19a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53865302-99c2-44ce-92cd-9697cddccec3", "name": "network-vif-deleted", "tag": "a8f14e5c-e5b3-4995-9f12-6c88043497cd"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:40:31.459583 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-2e35fbf5-5e1c-40c6-a000-3b9ec01a21d6 req-78b041a3-8792-4982-8637-0035d4e19a58 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:31.459985 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-2e35fbf5-5e1c-40c6-a000-3b9ec01a21d6 req-78b041a3-8792-4982-8637-0035d4e19a58 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:31.460942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-2e35fbf5-5e1c-40c6-a000-3b9ec01a21d6 req-78b041a3-8792-4982-8637-0035d4e19a58 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:31.473251 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-2e35fbf5-5e1c-40c6-a000-3b9ec01a21d6 req-78b041a3-8792-4982-8637-0035d4e19a58 service nova] Creating event network-vif-deleted:a8f14e5c-e5b3-4995-9f12-6c88043497cd for instance 53865302-99c2-44ce-92cd-9697cddccec3 on hv-cinder-85083 Sep 15 12:40:31.478962 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-2e35fbf5-5e1c-40c6-a000-3b9ec01a21d6 req-78b041a3-8792-4982-8637-0035d4e19a58 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036149 Sep 15 12:40:31.479658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 435/889] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:40:32.291608 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:32.292267 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:40:32.299380 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:32.299845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:32.300870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:32.301558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:32.302015 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:32.302436 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:32.331790 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:32.332265 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:32.332692 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:32.333228 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lazy-loading 'fault' on Instance uuid 53865302-99c2-44ce-92cd-9697cddccec3 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:40:32.373739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80b9d3e4810be863d54a8bb7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62b434017e447f88e0a1cf275ba27bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:40:32.381647 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-bb2b7e1a-36e8-4330-9762-f39c5749b895 tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 200 len: 1388 microversion: 2.1 time: 0.094870 Sep 15 12:40:32.382254 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 455/890] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:40:32 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:40:33.405944 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:33.406695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] [instance: 53865302-99c2-44ce-92cd-9697cddccec3] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:40:33.412820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:33.413296 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:33.413722 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:33.414395 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:40:33.414840 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:40:33.415259 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:40:33.429018 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] HTTP exception thrown: Instance 53865302-99c2-44ce-92cd-9697cddccec3 could not be found. Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Request method failure captured: Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 HTTP/1.1 Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIxw5ygSxdtatTQmsNKYYfUHF2GEtUPwBvKMSltiJq60YlRHEB5512nlREBgAsA7TEQ7ldWumTfkqVUCWW6ImvSI5vtyToeASagqn-DUKcopXRKNSBCnym7N8JuA3TRIS5vAV8RqqwwUvh55v5JzaFK5U222Ls06bSQoYbwAL-0e2Vuo Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: d62b434017e447f88e0a1cf275ba27bb Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestShelveInstance-761564073 Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:40:33.430657 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d62b434017e447f88e0a1cf275ba27bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d62b434017e447f88e0a1cf275ba27bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d62b434017e447f88e0a1cf275ba27bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d62b434017e447f88e0a1cf275ba27bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestShelveInstance-761564073 Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: d62b434017e447f88e0a1cf275ba27bb Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestShelveInstance-761564073 Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestShelveInstance-761564073-project Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: d36ce80b9d3e4810be863d54a8bb7865 Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestShelveInstance-761564073-project Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 53865302-99c2-44ce-92cd-9697cddccec3 could not be found. Sep 15 12:40:33.432329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '53865302-99c2-44ce-92cd-9697cddccec3'} Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53865302-99c2-44ce-92cd-9697cddccec3 could not be found. Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:40:33.433371 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53865302-99c2-44ce-92cd-9697cddccec3 could not be found. Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53865302-99c2-44ce-92cd-9697cddccec3 could not be found. Sep 15 12:40:33.435028 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:40:33.436609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Returning 404 to user: Instance 53865302-99c2-44ce-92cd-9697cddccec3 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:40:33.436609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-e24b1e5b-8d4e-49ca-9ba1-5f93c1a904ea tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3" status: 404 len: 111 microversion: 2.1 time: 0.030762 Sep 15 12:40:33.436609 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 436/891] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:40:33 2022] GET /compute/v2.1/servers/53865302-99c2-44ce-92cd-9697cddccec3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:40:33.595728 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2a245fc8-c453-4455-8f7a-92dd26c6f31a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] Calling method '.version_select at 0x7ff0d050edc0>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:40:33.619978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2a245fc8-c453-4455-8f7a-92dd26c6f31a tempest-TestShelveInstance-761564073 tempest-TestShelveInstance-761564073-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1324124335" status: 202 len: 0 microversion: 2.1 time: 0.028173 Sep 15 12:40:33.620617 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 456/892] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Sep 15 12:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1324124335 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 12:40:50.277744 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:50.278648 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:50.451524 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-22e1cbb7-d423-4cfe-9a17-5d7fbca083a2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Action: 'create', calling method: .version_select at 0x7ff0d0449f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-432651685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+m6kJZzpToWvRbZtlUoihiiOe23SSVL92EUrnnsGZhr/8HuKQnxs+KK7hTC0le1ycgQmygAeWBlVsvDKSlYXFg77ELbo5NTUdMRfuqjnU5my0DePZj6afIJOW+N7XAg=="}} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:40:50.470768 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-22e1cbb7-d423-4cfe-9a17-5d7fbca083a2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for project 923986fe38f542549682ddff9eb63ff1. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:40:50.475645 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.quota [None req-22e1cbb7-d423-4cfe-9a17-5d7fbca083a2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for user 593948925ca642c196cbdef04985374f and project 923986fe38f542549682ddff9eb63ff1. Resources: {'key_pairs'} {{(pid=120436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:40:50.502056 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-22e1cbb7-d423-4cfe-9a17-5d7fbca083a2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.231292 Sep 15 12:40:50.502710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 437/893] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 12:40:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:41:07.821866 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=22 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:07.822602 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:07.826476 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1499565363", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-432651685", "security_groups": [{"name": "tempest-secgroup-smoke-1679484133"}], "block_device_mapping_v2": [{"uuid": "e9fafe93-554f-4c4c-afa5-2bcef6501012", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1a75d53c-261a-43f5-b666-383189fd56aa"}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:41:07.942095 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] validate_networks() for [('1a75d53c-261a-43f5-b666-383189fd56aa', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:41:08.295834 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:41:08.296262 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:41:08.296740 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:41:08.297183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:41:08.297598 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:41:08.307137 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:08.307609 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:08.308036 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:08.308748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:08.309217 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:08.309636 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:08.326295 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for project 923986fe38f542549682ddff9eb63ff1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:41:08.330224 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for user 593948925ca642c196cbdef04985374f and project 923986fe38f542549682ddff9eb63ff1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:41:08.386774 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:41:08.388933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9fafe93-554f-4c4c-afa5-2bcef6501012',volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:41:08.515284 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b47177d1-61aa-4390-9eca-95972d708e54 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695272 Sep 15 12:41:08.515933 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 457/894] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:41:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:41:08.525288 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=4 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:08.526032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:08.530843 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-fa32ce30-3ec8-4f86-bf8c-83aa5618d868 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:08.531445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-fa32ce30-3ec8-4f86-bf8c-83aa5618d868 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:08.587032 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-fa32ce30-3ec8-4f86-bf8c-83aa5618d868 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:08.593938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-fa32ce30-3ec8-4f86-bf8c-83aa5618d868 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1094 microversion: 2.1 time: 0.070477 Sep 15 12:41:08.594705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 438/895] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:08 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:09.618347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:09.618949 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:09.625822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:09.626306 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:09.626737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:09.627425 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:09.627872 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:09.628286 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:09.698034 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:09.705628 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-db975f84-2728-43eb-a511-59315d217f5f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1200 microversion: 2.1 time: 0.091847 Sep 15 12:41:09.706225 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 458/896] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:09 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:10.730055 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:10.730666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:10.890224 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:10.890716 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:10.891152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:10.891862 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:10.892311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:10.893300 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:11.049423 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:11.059263 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5f7b60f3-02f9-4e2f-9d00-7c5e5757e2ac tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.333524 Sep 15 12:41:11.060288 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 439/897] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:10 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:41:11.082018 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-4d6a1a74-cefb-4412-96c8-78948a7da71c req-52e90efb-4074-49ca-8d06-8996c94bee74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6", "tag": "9cc7c9aa-ccd0-4297-8244-afb943c404e8"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:41:11.094833 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4d6a1a74-cefb-4412-96c8-78948a7da71c req-52e90efb-4074-49ca-8d06-8996c94bee74 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:11.095253 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4d6a1a74-cefb-4412-96c8-78948a7da71c req-52e90efb-4074-49ca-8d06-8996c94bee74 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:11.096482 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4d6a1a74-cefb-4412-96c8-78948a7da71c req-52e90efb-4074-49ca-8d06-8996c94bee74 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:11.107675 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-4d6a1a74-cefb-4412-96c8-78948a7da71c req-52e90efb-4074-49ca-8d06-8996c94bee74 service nova] Creating event network-changed:9cc7c9aa-ccd0-4297-8244-afb943c404e8 for instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 on hv-cinder-85083 Sep 15 12:41:11.112909 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-4d6a1a74-cefb-4412-96c8-78948a7da71c req-52e90efb-4074-49ca-8d06-8996c94bee74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109945 Sep 15 12:41:11.113377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 459/898] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:41:12.088835 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:12.089549 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:12.095868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:12.096350 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:12.096807 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:12.097495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:12.097955 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:12.098377 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:12.228232 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:12.235848 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6070c1e0-9eab-4340-a6c6-51ba3325af4c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.151196 Sep 15 12:41:12.236949 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 440/899] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:12 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:41:13.259645 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:13.260264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:13.267391 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:13.268416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:13.268875 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:13.269558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:13.270009 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:13.270432 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:13.400546 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:13.408209 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-1163147e-d87c-4490-b655-3fa10f8a12a3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.153394 Sep 15 12:41:13.408799 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 460/900] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:13 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:14.430533 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:14.431176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:14.437613 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:14.438102 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:14.438538 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:14.439231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:14.440189 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:14.440610 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:14.567233 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:14.574773 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-00cc9131-c1e5-4d05-b6f7-eb26189f0a6d tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.148131 Sep 15 12:41:14.575329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 441/901] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:14 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:15.597896 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:15.598494 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:15.604947 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:15.605424 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:15.605852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:15.606531 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:15.606976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:15.607402 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:15.738845 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:15.746429 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-ba8621a8-78c4-4d19-ad85-48c6d8b9eaa5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.153051 Sep 15 12:41:15.746989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 461/902] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:15 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:16.768607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:16.769256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:16.775598 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:16.776080 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:16.776951 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:16.777207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:16.777658 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:16.778081 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:16.904522 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:16.912121 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d30fa9f7-d092-4f08-8819-16723885745e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.147481 Sep 15 12:41:16.912710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 442/903] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:16 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:17.935096 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:17.935742 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:17.942686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:17.943162 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:17.943591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:17.944302 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:17.944746 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:17.945188 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:18.079177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:18.087532 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c88b0985-e3a4-4b2d-a9d5-c4302969302c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.156432 Sep 15 12:41:18.088101 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 462/904] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:17 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:19.109723 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:19.110397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:19.113087 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:19.118391 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:19.118868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:19.119303 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:19.119986 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:19.120434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:19.120879 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:19.250704 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:19.258298 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b5372a31-14c2-4962-9ef9-c7c306327101 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.152519 Sep 15 12:41:19.258859 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 443/905] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:19 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:20.281195 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:20.281811 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:20.284300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:20.284999 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:41:20.290166 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:20.290644 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:20.291081 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:20.291762 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:20.292245 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:20.292667 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:20.422810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:20.431251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-f3040131-5e6b-4ef7-bb6c-98467fc15573 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.153876 Sep 15 12:41:20.431823 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 463/906] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:20 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:21.453505 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:21.454138 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:21.461277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:21.461755 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:21.462188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:21.462872 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:21.463323 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:21.463745 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:21.599920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:21.609126 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8f536201-43b5-4647-a10b-31595005fcec tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.159488 Sep 15 12:41:21.609787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 444/907] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:21 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:21.716072 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-4d9027a6-30cb-4972-8ca2-8dba434dc04c req-b2092a8d-bdad-41c5-a236-4a8a09c868ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6", "name": "network-vif-plugged", "status": "completed", "tag": "9cc7c9aa-ccd0-4297-8244-afb943c404e8"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:41:21.726418 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4d9027a6-30cb-4972-8ca2-8dba434dc04c req-b2092a8d-bdad-41c5-a236-4a8a09c868ac service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:21.727049 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4d9027a6-30cb-4972-8ca2-8dba434dc04c req-b2092a8d-bdad-41c5-a236-4a8a09c868ac service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:21.727486 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-4d9027a6-30cb-4972-8ca2-8dba434dc04c req-b2092a8d-bdad-41c5-a236-4a8a09c868ac service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:21.739260 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-4d9027a6-30cb-4972-8ca2-8dba434dc04c req-b2092a8d-bdad-41c5-a236-4a8a09c868ac service nova] Creating event network-vif-plugged:9cc7c9aa-ccd0-4297-8244-afb943c404e8 for instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 on hv-cinder-85083 Sep 15 12:41:21.744281 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-4d9027a6-30cb-4972-8ca2-8dba434dc04c req-b2092a8d-bdad-41c5-a236-4a8a09c868ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Sep 15 12:41:21.744916 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 464/908] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:41:22.631945 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:22.632555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:22.638994 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:22.639476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:22.639910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:22.640597 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:22.641198 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:22.641625 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:22.769687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:22.777271 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7b220db4-33e3-4da5-9e05-ddf78525a383 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1266 microversion: 2.1 time: 0.149698 Sep 15 12:41:22.777830 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 445/909] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:22 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:23.800814 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:23.801526 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:23.807911 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:23.808393 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:23.808870 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:23.809552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:23.809997 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:23.810418 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:23.941259 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:23.948886 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-be47677c-32e6-4e90-9b5f-5e2b9d74d746 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1454 microversion: 2.1 time: 0.153080 Sep 15 12:41:23.949451 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 465/910] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:23 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:23.971235 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:41:23.971854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:41:23.978329 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:23.978811 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:23.979247 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:23.979942 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:23.980395 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:23.980841 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:24.107421 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:41:24.115142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-8a33ac1b-9ad6-4f7d-b8fd-a97b25d34765 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1454 microversion: 2.1 time: 0.147768 Sep 15 12:41:24.115703 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 446/911] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:41:23 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:41:25.793415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-117b95dc-fd57-4b45-b77d-680641a698ad req-09123882-a84c-4971-bff0-9ccd4d3179cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6", "tag": "9cc7c9aa-ccd0-4297-8244-afb943c404e8"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:41:25.803154 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-117b95dc-fd57-4b45-b77d-680641a698ad req-09123882-a84c-4971-bff0-9ccd4d3179cd service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:41:25.803622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-117b95dc-fd57-4b45-b77d-680641a698ad req-09123882-a84c-4971-bff0-9ccd4d3179cd service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:41:25.804048 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-117b95dc-fd57-4b45-b77d-680641a698ad req-09123882-a84c-4971-bff0-9ccd4d3179cd service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:41:25.815474 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-117b95dc-fd57-4b45-b77d-680641a698ad req-09123882-a84c-4971-bff0-9ccd4d3179cd service nova] Creating event network-changed:9cc7c9aa-ccd0-4297-8244-afb943c404e8 for instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 on hv-cinder-85083 Sep 15 12:41:25.821174 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-117b95dc-fd57-4b45-b77d-680641a698ad req-09123882-a84c-4971-bff0-9ccd4d3179cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084951 Sep 15 12:41:25.821938 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 466/912] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:43:23.049047 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76a84b38-a861-468c-ba66-68b6866cc13d] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 12:43:23.049681 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:43:23.049811 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Thu Sep 15 12:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 (ip 10.222.0.15) !!! Sep 15 12:43:23.051159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 15 12:43:23.051898 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:43:23.051998 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Thu Sep 15 12:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 (ip 10.222.0.15) !!! Sep 15 12:43:23.053021 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=20 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:23.054403 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=48 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:23.059100 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:23.059600 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:23.069865 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:23.070349 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:23.070792 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:23.071496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:23.071953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:23.072423 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:23.103363 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Going to try to terminate instance {{(pid=120436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:43:23.187518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-09e79428-4b5d-453d-9761-516dba9a6886 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 204 len: 0 microversion: 2.1 time: 0.140346 Sep 15 12:43:23.188089 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 447/913] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:43:23 2022] DELETE /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:43:23.194505 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e77fc1a6-c3f6-4ea9-8d37-e56f1f7c4191] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 12:43:23.195496 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 12:43:23.195621 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Thu Sep 15 12:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 (ip 10.222.0.15) !!! Sep 15 12:43:23.196942 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 15 12:43:23.198072 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:23.198828 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=44 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:23.206387 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:23.207193 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:23.217422 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:23.217898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:23.218330 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:23.219022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:23.219473 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:23.219898 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:23.353427 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:23.361229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2c656ea3-7668-42da-a6a0-be331cab1e37 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1579 microversion: 2.1 time: 0.168628 Sep 15 12:43:23.361783 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 467/914] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:23 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:24.384441 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:24.385176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:24.392495 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:24.393007 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:24.393446 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:24.394129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:24.394577 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:24.394999 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:24.402295 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO oslo.messaging._drivers.impl_rabbit [-] [76a84b38-a861-468c-ba66-68b6866cc13d] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51778. Sep 15 12:43:24.524801 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:24.532464 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2de53e61-8c7e-42ce-a55d-cbbd97a23dd1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1579 microversion: 2.1 time: 0.152776 Sep 15 12:43:24.533065 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 448/915] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:24 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:25.555097 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:25.555822 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:25.563544 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:25.564108 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:25.564634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:25.565419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:25.565943 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:25.566437 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:25.572587 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO oslo.messaging._drivers.impl_rabbit [-] [e77fc1a6-c3f6-4ea9-8d37-e56f1f7c4191] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51782. Sep 15 12:43:25.628802 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:25.636615 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c22200c8-e727-4438-8ba6-d07351e1fc02 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1511 microversion: 2.1 time: 0.085685 Sep 15 12:43:25.637464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 468/916] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:25 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:25.801883 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-40b737e3-6b55-4798-94cd-75e802c38d54 req-2e415d89-f5e4-4a5a-babb-dfccea6c03a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6", "name": "network-vif-deleted", "tag": "9cc7c9aa-ccd0-4297-8244-afb943c404e8"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:43:25.813584 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-40b737e3-6b55-4798-94cd-75e802c38d54 req-2e415d89-f5e4-4a5a-babb-dfccea6c03a1 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:25.814192 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-40b737e3-6b55-4798-94cd-75e802c38d54 req-2e415d89-f5e4-4a5a-babb-dfccea6c03a1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:25.814901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-40b737e3-6b55-4798-94cd-75e802c38d54 req-2e415d89-f5e4-4a5a-babb-dfccea6c03a1 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:25.828693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-40b737e3-6b55-4798-94cd-75e802c38d54 req-2e415d89-f5e4-4a5a-babb-dfccea6c03a1 service nova] Creating event network-vif-deleted:9cc7c9aa-ccd0-4297-8244-afb943c404e8 for instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 on hv-cinder-85083 Sep 15 12:43:25.834204 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-40b737e3-6b55-4798-94cd-75e802c38d54 req-2e415d89-f5e4-4a5a-babb-dfccea6c03a1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035877 Sep 15 12:43:25.836221 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 449/917] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:43:26.660552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:26.661211 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:26.669377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:26.670384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:26.670881 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:26.671620 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:26.672141 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:26.672562 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:26.711591 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:26.712059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:26.712504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:26.713002 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.objects.instance [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lazy-loading 'fault' on Instance uuid 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 {{(pid=120437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 12:43:26.758760 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:26.767186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-50bb697d-a4fb-4507-99fa-e993b76db826 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 200 len: 1184 microversion: 2.1 time: 0.111053 Sep 15 12:43:26.768109 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 469/918] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:26 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 1184 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:27.791132 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:27.791834 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:27.798743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:27.799231 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:27.799670 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:27.800357 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:27.800836 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:27.801266 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:27.814752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] HTTP exception thrown: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Request method failure captured: Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 HTTP/1.1 Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIx1N0rl3dv3bXxSyFA61Y8rtAhXGm7R6GDG1njA14cEk0SBQlszQ8vtyjwWRHtJ4C4ieP2uEQzmuUM_4uKukpzKKi3cb-oeWSOt2sA-TyoZxwOk6zCEjGnPBvOBRam1P33waZOjLhHM79N2r5rDeG7DXo51X7gv43Xpp1i5IMCGMuFk Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:43:27.816346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_923986fe38f542549682ddff9eb63ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestVolumeBootPattern-228125241 Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 593948925ca642c196cbdef04985374f Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:43:27.818157 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6'} Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:43:27.819179 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:43:27.821433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:43:27.823053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Returning 404 to user: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:43:27.823053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4f7e46e5-1730-4a66-a665-0c11d5d415d6 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 404 len: 111 microversion: 2.1 time: 0.030858 Sep 15 12:43:27.823053 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 450/919] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:27 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:43:27.864867 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1087566393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-432651685", "security_groups": [{"name": "tempest-secgroup-smoke-1679484133"}], "block_device_mapping_v2": [{"uuid": "e9fafe93-554f-4c4c-afa5-2bcef6501012", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1a75d53c-261a-43f5-b666-383189fd56aa"}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:43:27.982416 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] validate_networks() for [('1a75d53c-261a-43f5-b666-383189fd56aa', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:43:28.384213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:43:28.384634 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:43:28.385133 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:43:28.385542 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:43:28.385979 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:43:28.394735 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:28.395222 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:28.395664 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:28.396388 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:28.396869 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:28.397301 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:28.414205 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for project 923986fe38f542549682ddff9eb63ff1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:43:28.418201 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for user 593948925ca642c196cbdef04985374f and project 923986fe38f542549682ddff9eb63ff1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:43:28.474776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:43:28.477485 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9fafe93-554f-4c4c-afa5-2bcef6501012',volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:43:28.607764 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-5d6b7def-d038-4b83-ae59-da46f1d2baf5 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746666 Sep 15 12:43:28.608340 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 470/920] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:43:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:43:28.619305 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-5f6c38d9-f12d-4add-8154-5caa180f1bf4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:28.619927 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-5f6c38d9-f12d-4add-8154-5caa180f1bf4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:28.675526 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-5f6c38d9-f12d-4add-8154-5caa180f1bf4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:28.683338 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-5f6c38d9-f12d-4add-8154-5caa180f1bf4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1094 microversion: 2.1 time: 0.067911 Sep 15 12:43:28.683943 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 451/921] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:28 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:29.706170 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:29.706944 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:29.714926 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:29.715501 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:29.716005 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:29.716824 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:29.717356 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:29.717835 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:29.792263 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:29.800980 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-3d8053c0-db0a-4631-bfe6-9f3537af1117 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1200 microversion: 2.1 time: 0.099234 Sep 15 12:43:29.801587 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 471/922] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:29 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:30.823767 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:30.824389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:30.834017 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:30.834508 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:30.835500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:30.836457 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:30.836948 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:30.837382 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:30.971501 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:30.980475 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-69d10f72-d2f9-4326-891a-ccdd9d902172 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.160525 Sep 15 12:43:30.981190 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 452/923] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:30 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:31.323084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-10f379a3-0e7b-4a2f-b0f9-23b56f01c4d3 req-9d1b0750-8ef9-4465-aca2-725c31b75bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cae46b-26d0-461d-bc1b-65eee2f14e04", "tag": "4503fbf9-612b-4a2c-9e2c-b2b2b089a007"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:43:31.337558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-10f379a3-0e7b-4a2f-b0f9-23b56f01c4d3 req-9d1b0750-8ef9-4465-aca2-725c31b75bfe service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:31.338043 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-10f379a3-0e7b-4a2f-b0f9-23b56f01c4d3 req-9d1b0750-8ef9-4465-aca2-725c31b75bfe service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:31.338477 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-10f379a3-0e7b-4a2f-b0f9-23b56f01c4d3 req-9d1b0750-8ef9-4465-aca2-725c31b75bfe service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:31.350377 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-10f379a3-0e7b-4a2f-b0f9-23b56f01c4d3 req-9d1b0750-8ef9-4465-aca2-725c31b75bfe service nova] Creating event network-changed:4503fbf9-612b-4a2c-9e2c-b2b2b089a007 for instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 on hv-cinder-85083 Sep 15 12:43:31.355604 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-10f379a3-0e7b-4a2f-b0f9-23b56f01c4d3 req-9d1b0750-8ef9-4465-aca2-725c31b75bfe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036296 Sep 15 12:43:31.356213 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 472/924] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 12:43:32.003433 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:32.004047 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:32.010741 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:32.011152 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:32.011622 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:32.012274 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:32.012733 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:32.013172 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:32.147987 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:32.155871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4fa2801f-8c4e-47df-a1bf-a2bfde3eeba0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.156369 Sep 15 12:43:32.156434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 453/925] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:31 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:33.179699 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:33.180319 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:33.186510 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:33.186984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:33.187414 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:33.188091 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:33.188535 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:33.188987 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:33.315631 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:33.323243 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b26bce91-91fd-4fb7-bf1e-ecd918be2887 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.148228 Sep 15 12:43:33.323815 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 473/926] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:33 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:34.346327 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:34.346941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:34.353907 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:34.354387 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:34.354821 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:34.355503 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:34.355953 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:34.356380 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:34.486245 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:34.494378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-cd21d542-0c54-4a0d-905c-8888cf86ab28 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.152013 Sep 15 12:43:34.494938 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 454/927] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:34 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:35.517131 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:35.517737 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:35.524610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:35.525118 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:35.525552 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:35.526237 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:35.526683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:35.527102 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:35.654836 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:35.662423 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-6ca50e95-65b9-4e55-b6a0-990f5ced81e0 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.149189 Sep 15 12:43:35.662989 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 474/928] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:35 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:36.684742 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:36.685408 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:36.691959 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:36.692452 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:36.692926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:36.693634 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:36.694607 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:36.695034 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:37.041191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:37.048854 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-480eeb1e-3706-45f4-8973-76760cba4e64 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.368005 Sep 15 12:43:37.049419 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 455/929] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:36 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:38.071347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:38.071967 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:38.078566 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:38.079053 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:38.079491 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:38.080182 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:38.080638 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:38.081094 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:38.206150 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:38.214001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-97ab92f9-f34f-4d85-9146-c8849591b39a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.146766 Sep 15 12:43:38.214567 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 475/930] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:38 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:39.237082 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:39.237640 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:39.240075 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:39.246111 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:39.246619 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:39.247054 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:39.247738 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:39.248191 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:39.248614 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:39.378518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:39.386748 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-7a602c47-bb48-4741-bddb-99a70de63809 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.153683 Sep 15 12:43:39.387312 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 456/931] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:39 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:40.408973 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:40.409597 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:40.411535 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:40.412188 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:43:40.418464 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:40.418945 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:40.419385 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:40.420071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:40.420524 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:40.420977 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:40.561611 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:40.570160 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-2bd196ac-a69c-4c4e-894f-2d46e904cf65 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.165100 Sep 15 12:43:40.570747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 476/932] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:40 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:40.677743 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-0e92265d-77cd-4263-898f-f00f8c33bad2 req-65f5ec80-23d7-4e3a-9cab-7b50ee1767c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cae46b-26d0-461d-bc1b-65eee2f14e04", "name": "network-vif-plugged", "status": "completed", "tag": "4503fbf9-612b-4a2c-9e2c-b2b2b089a007"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:43:40.687025 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0e92265d-77cd-4263-898f-f00f8c33bad2 req-65f5ec80-23d7-4e3a-9cab-7b50ee1767c7 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:40.687496 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0e92265d-77cd-4263-898f-f00f8c33bad2 req-65f5ec80-23d7-4e3a-9cab-7b50ee1767c7 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:40.687917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-0e92265d-77cd-4263-898f-f00f8c33bad2 req-65f5ec80-23d7-4e3a-9cab-7b50ee1767c7 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:40.699105 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-0e92265d-77cd-4263-898f-f00f8c33bad2 req-65f5ec80-23d7-4e3a-9cab-7b50ee1767c7 service nova] Creating event network-vif-plugged:4503fbf9-612b-4a2c-9e2c-b2b2b089a007 for instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 on hv-cinder-85083 Sep 15 12:43:40.703969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-0e92265d-77cd-4263-898f-f00f8c33bad2 req-65f5ec80-23d7-4e3a-9cab-7b50ee1767c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086818 Sep 15 12:43:40.704536 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 457/933] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:43:41.592690 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:41.593315 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:41.599747 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:41.600856 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:41.601300 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:41.601984 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:41.602439 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:41.602861 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:41.734068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:41.741795 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-24d116e3-506e-4ba2-a934-6c162e45b415 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1266 microversion: 2.1 time: 0.152968 Sep 15 12:43:41.742362 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 477/934] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:41 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:42.765827 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:42.766555 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:42.773219 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:42.773699 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:42.774137 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:42.774826 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:42.775281 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:42.775705 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:42.911741 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:42.920030 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-58e1764d-c9f2-4bee-9355-820ca11929a7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1453 microversion: 2.1 time: 0.158957 Sep 15 12:43:42.920599 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 458/935] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:42 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:42.941454 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:43:42.942071 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:43:42.948382 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:42.948901 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:42.949338 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:42.950022 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:42.950475 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:42.950900 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:43.082732 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:43:43.090748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-e08517cf-5f01-441a-97de-6e94a7f3ee17 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1453 microversion: 2.1 time: 0.153120 Sep 15 12:43:43.091357 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 478/936] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:43:42 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:43:44.644316 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-34c90f3a-99f9-4f00-a73a-996c382998de req-97c3becd-2cd8-446d-9e62-de38aece8604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cae46b-26d0-461d-bc1b-65eee2f14e04", "tag": "4503fbf9-612b-4a2c-9e2c-b2b2b089a007"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:43:44.654647 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-34c90f3a-99f9-4f00-a73a-996c382998de req-97c3becd-2cd8-446d-9e62-de38aece8604 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:43:44.655195 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-34c90f3a-99f9-4f00-a73a-996c382998de req-97c3becd-2cd8-446d-9e62-de38aece8604 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:43:44.655695 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-34c90f3a-99f9-4f00-a73a-996c382998de req-97c3becd-2cd8-446d-9e62-de38aece8604 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:43:44.667323 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-34c90f3a-99f9-4f00-a73a-996c382998de req-97c3becd-2cd8-446d-9e62-de38aece8604 service nova] Creating event network-changed:4503fbf9-612b-4a2c-9e2c-b2b2b089a007 for instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 on hv-cinder-85083 Sep 15 12:43:44.672528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-34c90f3a-99f9-4f00-a73a-996c382998de req-97c3becd-2cd8-446d-9e62-de38aece8604 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031792 Sep 15 12:43:44.673234 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 459/937] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:45:30.444617 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.445415 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=66 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.449456 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-512679782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-432651685", "security_groups": [{"name": "tempest-secgroup-smoke-1679484133"}], "block_device_mapping_v2": [{"uuid": "bca13c3f-a363-4fde-91ef-ac940e29d0a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1a75d53c-261a-43f5-b666-383189fd56aa"}]}} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:45:30.709375 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.network.neutron [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] validate_networks() for [('1a75d53c-261a-43f5-b666-383189fd56aa', None, None, None, None, None)] {{(pid=120437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 12:45:31.069457 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Flavor limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 12:45:31.069908 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Image limits 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 12:45:31.070384 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Flavor pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 12:45:31.070796 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Image pref 0:0:0 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 12:45:31.071206 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.virt.hardware [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 12:45:31.080059 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:31.080536 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:31.081007 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:31.081729 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:31.082181 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:31.082610 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:31.100260 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for project 923986fe38f542549682ddff9eb63ff1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 12:45:31.104251 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.quota [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Getting quotas for user 593948925ca642c196cbdef04985374f and project 923986fe38f542549682ddff9eb63ff1. Resources: {'ram', 'cores', 'instances'} {{(pid=120437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 12:45:31.163229 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Going to run 1 instances... {{(pid=120437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 12:45:31.165392 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bca13c3f-a363-4fde-91ef-ac940e29d0a5',volume_size=None,volume_type=None)] {{(pid=120437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 12:45:31.292959 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d9ea9d28-8cd3-42da-9fc7-e81f6d25f6d2 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.851160 Sep 15 12:45:31.293615 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 479/938] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 12:45:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 12:45:31.303996 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.305456 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.310076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-cebd4da4-cdcc-4d14-ba49-8e8882e347c1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:31.310818 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-cebd4da4-cdcc-4d14-ba49-8e8882e347c1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:31.434137 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-cebd4da4-cdcc-4d14-ba49-8e8882e347c1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:31.441225 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-cebd4da4-cdcc-4d14-ba49-8e8882e347c1 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1093 microversion: 2.1 time: 0.140402 Sep 15 12:45:31.441787 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 460/939] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:31 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1093 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:32.464904 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:32.465672 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:32.473303 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:32.473791 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:32.474223 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:32.474912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:32.475359 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:32.475777 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:32.544234 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:32.553403 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-8a67897a-a5db-418a-8209-3fe02eb414f9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1209 microversion: 2.1 time: 0.092860 Sep 15 12:45:32.554428 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 480/940] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:32 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:33.578289 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:33.579782 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:33.588778 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:33.589279 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:33.589837 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:33.590571 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:33.591031 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:33.591883 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:33.731803 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:33.739654 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-2f8b99c1-35cb-4539-9851-37131a201164 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.165250 Sep 15 12:45:33.740820 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 461/941] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:33 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:34.500124 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-58a1a910-088e-4431-a844-556158928639 req-efc07d9e-b967-41fa-8ff2-a1142cbf0979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fcdd8ab-8b06-49b0-9263-5eba353625e8", "tag": "854e692c-163f-486e-9e52-10ca48ab8e9e"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:45:34.512622 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-58a1a910-088e-4431-a844-556158928639 req-efc07d9e-b967-41fa-8ff2-a1142cbf0979 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:34.513145 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-58a1a910-088e-4431-a844-556158928639 req-efc07d9e-b967-41fa-8ff2-a1142cbf0979 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:34.513576 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-58a1a910-088e-4431-a844-556158928639 req-efc07d9e-b967-41fa-8ff2-a1142cbf0979 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:34.526978 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-58a1a910-088e-4431-a844-556158928639 req-efc07d9e-b967-41fa-8ff2-a1142cbf0979 service nova] Creating event network-changed:854e692c-163f-486e-9e52-10ca48ab8e9e for instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 on hv-cinder-85083 Sep 15 12:45:34.532605 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-58a1a910-088e-4431-a844-556158928639 req-efc07d9e-b967-41fa-8ff2-a1142cbf0979 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037000 Sep 15 12:45:34.533255 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 481/942] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:45:34.763666 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:34.764207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:34.771518 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:34.773868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:34.773868 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:34.774160 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:34.774617 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:34.775075 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:34.923090 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:34.931872 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-918661f7-a346-4525-bb81-2ba8abdf69e4 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.172367 Sep 15 12:45:34.932445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 462/943] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:34 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:35.956023 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:35.957000 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:35.965191 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:35.965683 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:35.966126 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:35.967110 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:35.967480 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:35.967909 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:36.098389 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:36.106125 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-85b35b48-9ba6-4cd9-8b59-4dae2fb700c3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.154355 Sep 15 12:45:36.106723 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 482/944] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:35 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:37.128997 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:37.129635 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:37.136256 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:37.136739 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:37.137230 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:37.137920 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:37.138397 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:37.138819 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:37.265177 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:37.273401 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-c007d641-1b69-4e8a-8100-52203e5f8f47 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.148336 Sep 15 12:45:37.273980 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 463/945] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:37 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:38.295522 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:38.296050 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:38.302976 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:38.303451 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:38.303878 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:38.304558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:38.305051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:38.305472 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:38.434849 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:38.442504 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b9793560-09a9-42f1-948a-027d6751ec18 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.150916 Sep 15 12:45:38.443717 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 483/946] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:38 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:39.466627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:39.467277 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:39.476512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:39.477310 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:39.477760 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:39.478453 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:39.478906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:39.479334 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:39.605580 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:39.613119 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6dd3d42f-0c9e-436b-a427-7c3335976866 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.151054 Sep 15 12:45:39.613687 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 464/947] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:39 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:40.636111 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:40.636740 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:40.643643 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:40.644121 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:40.644551 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:40.645259 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:40.645708 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:40.646183 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:40.778872 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:40.786632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0f03f7b7-f9e7-4b1c-af2b-76dae3b0376b tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.154426 Sep 15 12:45:40.787198 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 484/948] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:40 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:41.809128 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:41.809740 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:41.812650 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell0:SELECT=2 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:41.818617 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:41.819097 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:41.819692 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:41.820384 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:41.820864 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:41.821304 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:41.951011 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:41.959438 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-614e6a8b-3cd9-4b65-91a4-2f53e0a9d482 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.153472 Sep 15 12:45:41.960278 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 465/949] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:41 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:42.982034 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:42.982646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:42.984700 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=2 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.985410 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell0:SELECT=6 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.991593 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:42.992068 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:42.992499 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:42.993208 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:42.993684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:42.994074 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:43.128051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:43.135648 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-076d886e-5a0e-4797-88f6-9f8d5c1c37ca tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.157551 Sep 15 12:45:43.136215 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 485/950] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:42 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:44.158356 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:44.158974 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:44.165418 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:44.165902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:44.166342 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:44.167029 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:44.167479 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:44.167910 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:44.296237 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:44.304378 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-110220db-2874-4c82-ab5d-89e0b926b5d9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.149934 Sep 15 12:45:44.304996 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 466/951] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:44 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:45:45.327572 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:45.328215 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:45.335602 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:45.336084 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:45.336514 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:45.337241 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:45.337686 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:45.338114 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:45.470868 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:45.478530 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-82489ae3-8923-47be-8b22-0b8a20650848 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.155080 Sep 15 12:45:45.479090 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 486/952] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:45 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:46.500863 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:46.501405 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:46.507715 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:46.508188 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:46.508621 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:46.509330 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:46.509777 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:46.510193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:46.640448 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:46.648143 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-73cbfc51-8b7a-4b69-a9a1-32ee8e7d7e6f tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.151138 Sep 15 12:45:46.648728 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 467/953] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:46 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:47.239972 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-04914783-e271-4ac6-b82a-81da15adc9d6 req-3d3fc047-cce7-43d6-b541-8c46dba5ab3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fcdd8ab-8b06-49b0-9263-5eba353625e8", "name": "network-vif-plugged", "status": "completed", "tag": "854e692c-163f-486e-9e52-10ca48ab8e9e"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:45:47.250308 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-04914783-e271-4ac6-b82a-81da15adc9d6 req-3d3fc047-cce7-43d6-b541-8c46dba5ab3f service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:47.250792 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-04914783-e271-4ac6-b82a-81da15adc9d6 req-3d3fc047-cce7-43d6-b541-8c46dba5ab3f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:47.251269 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-04914783-e271-4ac6-b82a-81da15adc9d6 req-3d3fc047-cce7-43d6-b541-8c46dba5ab3f service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:47.263142 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-04914783-e271-4ac6-b82a-81da15adc9d6 req-3d3fc047-cce7-43d6-b541-8c46dba5ab3f service nova] Creating event network-vif-plugged:854e692c-163f-486e-9e52-10ca48ab8e9e for instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 on hv-cinder-85083 Sep 15 12:45:47.268155 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-04914783-e271-4ac6-b82a-81da15adc9d6 req-3d3fc047-cce7-43d6-b541-8c46dba5ab3f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Sep 15 12:45:47.268776 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 487/954] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:45:47.670572 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:47.671186 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:47.679045 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:47.679527 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:47.679969 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:47.680655 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:47.681133 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:47.681560 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:47.807528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:47.815129 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-d7511533-ee79-4ce5-b792-5871d6d1252a tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.148416 Sep 15 12:45:47.815693 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 468/955] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:47 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:48.838034 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:48.838748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:48.844855 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:48.845334 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:48.845769 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:48.846447 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:48.846891 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:48.847309 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:48.980400 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:48.988042 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-7d40c5c3-0957-40b9-acf7-be2ba65e3a71 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1265 microversion: 2.1 time: 0.155027 Sep 15 12:45:48.988602 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 488/956] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:48 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:50.013500 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:50.014243 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:50.020785 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:50.021311 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:50.021752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:50.022446 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:50.022902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:50.023331 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:50.188512 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:50.196238 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-b372c090-8497-4d00-899f-1dd2da3d4478 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1452 microversion: 2.1 time: 0.188361 Sep 15 12:45:50.196825 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 469/957] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:50 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:50.217950 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:45:50.218558 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:45:50.225498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:50.225916 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:50.226344 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:50.227020 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:50.227465 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:50.227884 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:50.353614 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:45:50.361236 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-b019c75d-7241-4af9-a26f-3f66945261e7 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1452 microversion: 2.1 time: 0.147131 Sep 15 12:45:50.361804 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 489/958] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:45:50 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:52.115437 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-a85dcf8e-58d1-4eed-8c4d-956052efeef4 req-9375c948-9db2-4e4f-bf79-af76d2e1e93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fcdd8ab-8b06-49b0-9263-5eba353625e8", "tag": "854e692c-163f-486e-9e52-10ca48ab8e9e"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:45:52.126092 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-a85dcf8e-58d1-4eed-8c4d-956052efeef4 req-9375c948-9db2-4e4f-bf79-af76d2e1e93b service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:45:52.126680 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-a85dcf8e-58d1-4eed-8c4d-956052efeef4 req-9375c948-9db2-4e4f-bf79-af76d2e1e93b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:45:52.127178 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-a85dcf8e-58d1-4eed-8c4d-956052efeef4 req-9375c948-9db2-4e4f-bf79-af76d2e1e93b service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:45:52.138855 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-a85dcf8e-58d1-4eed-8c4d-956052efeef4 req-9375c948-9db2-4e4f-bf79-af76d2e1e93b service nova] Creating event network-changed:854e692c-163f-486e-9e52-10ca48ab8e9e for instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 on hv-cinder-85083 Sep 15 12:45:52.143900 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-a85dcf8e-58d1-4eed-8c4d-956052efeef4 req-9375c948-9db2-4e4f-bf79-af76d2e1e93b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032205 Sep 15 12:45:52.144508 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 470/959] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:47:30.880365 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.881606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG dbcounter [-] [120437] Writing DB stats nova_cell1:SELECT=54 {{(pid=120437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.883901 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_api:SELECT=24 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.885445 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG dbcounter [-] [120436] Writing DB stats nova_cell1:SELECT=56 {{(pid=120436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.885948 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:30.886517 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:30.897014 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:30.897503 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:30.897934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:30.898632 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:30.899078 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:30.900186 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:30.926810 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:47:30.943685 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-76ce896f-cd33-42b7-b415-44510b41071f req-5b48efe7-191e-49f3-960c-445e5b527af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fcdd8ab-8b06-49b0-9263-5eba353625e8", "tag": "854e692c-163f-486e-9e52-10ca48ab8e9e"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:47:30.955322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-76ce896f-cd33-42b7-b415-44510b41071f req-5b48efe7-191e-49f3-960c-445e5b527af2 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:30.955322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-76ce896f-cd33-42b7-b415-44510b41071f req-5b48efe7-191e-49f3-960c-445e5b527af2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:30.955322 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-76ce896f-cd33-42b7-b415-44510b41071f req-5b48efe7-191e-49f3-960c-445e5b527af2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:30.965824 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-76ce896f-cd33-42b7-b415-44510b41071f req-5b48efe7-191e-49f3-960c-445e5b527af2 service nova] Creating event network-changed:854e692c-163f-486e-9e52-10ca48ab8e9e for instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 on hv-cinder-85083 Sep 15 12:47:30.971682 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-76ce896f-cd33-42b7-b415-44510b41071f req-5b48efe7-191e-49f3-960c-445e5b527af2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091631 Sep 15 12:47:30.972636 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 471/960] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:47:31.023541 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-c53e97ca-1b54-4d54-a8b9-f21ee2c44326 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 204 len: 0 microversion: 2.1 time: 0.146493 Sep 15 12:47:31.024161 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 490/961] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:47:30 2022] DELETE /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:47:31.033093 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:31.033806 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:31.046912 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:31.047497 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:31.048001 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:31.048803 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:31.049326 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:31.050059 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:31.189685 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:47:31.197814 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-4f57816c-9a1b-4fab-b1fe-f7e1ed54da2e tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1577 microversion: 2.1 time: 0.169107 Sep 15 12:47:31.198389 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 472/962] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:31 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:47:32.220946 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:32.221640 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:32.228171 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:32.228806 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:32.229376 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:32.230058 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:32.230606 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:32.231346 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:32.368285 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:47:32.376051 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-d2f5d4a7-e711-4028-9c62-8c66e880796c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1577 microversion: 2.1 time: 0.159367 Sep 15 12:47:32.376852 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 491/963] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:32 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:47:33.368099 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-c4efc7c1-1232-40d2-a3fa-e4c150e31811 req-1d5a473c-2689-4fff-8bcf-516fafd4fce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fcdd8ab-8b06-49b0-9263-5eba353625e8", "name": "network-vif-deleted", "tag": "854e692c-163f-486e-9e52-10ca48ab8e9e"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:47:33.377783 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c4efc7c1-1232-40d2-a3fa-e4c150e31811 req-1d5a473c-2689-4fff-8bcf-516fafd4fce2 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:33.378257 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c4efc7c1-1232-40d2-a3fa-e4c150e31811 req-1d5a473c-2689-4fff-8bcf-516fafd4fce2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:33.378683 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-c4efc7c1-1232-40d2-a3fa-e4c150e31811 req-1d5a473c-2689-4fff-8bcf-516fafd4fce2 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:33.390159 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-c4efc7c1-1232-40d2-a3fa-e4c150e31811 req-1d5a473c-2689-4fff-8bcf-516fafd4fce2 service nova] Creating event network-vif-deleted:854e692c-163f-486e-9e52-10ca48ab8e9e for instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 on hv-cinder-85083 Sep 15 12:47:33.395878 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-c4efc7c1-1232-40d2-a3fa-e4c150e31811 req-1d5a473c-2689-4fff-8bcf-516fafd4fce2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082564 Sep 15 12:47:33.396471 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 473/964] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:47:33.401264 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:33.401912 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:33.408345 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:33.408854 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:33.409289 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:33.409974 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:33.410426 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:33.410850 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:33.471299 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:47:33.478896 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-fd0d1291-d2e5-4173-8a11-a216d4ca8966 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 200 len: 1224 microversion: 2.1 time: 0.081977 Sep 15 12:47:33.479467 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 492/965] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:33 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 12:47:34.502710 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:34.503417 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 7fcdd8ab-8b06-49b0-9263-5eba353625e8] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:34.510142 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:34.510627 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:34.511062 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:34.511752 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:34.512207 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:34.512633 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:34.528253 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] HTTP exception thrown: Instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 could not be found. Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Request method failure captured: Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 HTTP/1.1 Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIx1N0rl3dv3bXxSyFA61Y8rtAhXGm7R6GDG1njA14cEk0SBQlszQ8vtyjwWRHtJ4C4ieP2uEQzmuUM_4uKukpzKKi3cb-oeWSOt2sA-TyoZxwOk6zCEjGnPBvOBRam1P33waZOjLhHM79N2r5rDeG7DXo51X7gv43Xpp1i5IMCGMuFk Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:47:34.529914 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_923986fe38f542549682ddff9eb63ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 593948925ca642c196cbdef04985374f Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 could not be found. Sep 15 12:47:34.531673 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '7fcdd8ab-8b06-49b0-9263-5eba353625e8'} Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 could not be found. Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:47:34.532842 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 could not be found. Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 could not be found. Sep 15 12:47:34.534530 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:34.536581 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Returning 404 to user: Instance 7fcdd8ab-8b06-49b0-9263-5eba353625e8 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:47:34.536581 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-3de20141-5baa-4302-abd9-ca0cbd529be3 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8" status: 404 len: 111 microversion: 2.1 time: 0.033315 Sep 15 12:47:34.536581 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 474/966] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:34 2022] GET /compute/v2.1/servers/7fcdd8ab-8b06-49b0-9263-5eba353625e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:47:37.596461 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:37.596982 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:37.605528 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [req-8fe74db5-e763-440d-a33c-2a933a6bb4c9 req-4df062a0-6382-4ea5-9376-6e32e0b1ee58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cae46b-26d0-461d-bc1b-65eee2f14e04", "tag": "4503fbf9-612b-4a2c-9e2c-b2b2b089a007"}]} {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:47:37.614934 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:37.615424 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:37.615856 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:37.616554 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:37.617030 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:37.617445 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:37.624404 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-8fe74db5-e763-440d-a33c-2a933a6bb4c9 req-4df062a0-6382-4ea5-9376-6e32e0b1ee58 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:37.624903 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-8fe74db5-e763-440d-a33c-2a933a6bb4c9 req-4df062a0-6382-4ea5-9376-6e32e0b1ee58 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:37.625332 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [req-8fe74db5-e763-440d-a33c-2a933a6bb4c9 req-4df062a0-6382-4ea5-9376-6e32e0b1ee58 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:37.637290 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.compute.server_external_events [req-8fe74db5-e763-440d-a33c-2a933a6bb4c9 req-4df062a0-6382-4ea5-9376-6e32e0b1ee58 service nova] Creating event network-changed:4503fbf9-612b-4a2c-9e2c-b2b2b089a007 for instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 on hv-cinder-85083 Sep 15 12:47:37.642946 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [req-8fe74db5-e763-440d-a33c-2a933a6bb4c9 req-4df062a0-6382-4ea5-9376-6e32e0b1ee58 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040307 Sep 15 12:47:37.643906 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 475/967] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:47:37.650114 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Going to try to terminate instance {{(pid=120437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 12:47:37.727329 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-29dd6cac-e309-4958-aec7-07d324967b84 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 204 len: 0 microversion: 2.1 time: 0.134609 Sep 15 12:47:37.728516 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 493/968] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:47:37 2022] DELETE /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 12:47:37.737176 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:37.738011 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:37.744285 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:37.744781 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:37.745230 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:37.745917 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:37.746367 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:37.746784 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:37.883602 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:47:37.891482 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-aacab1bf-9267-4d44-a0ff-9bc8007c397c tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1578 microversion: 2.1 time: 0.158478 Sep 15 12:47:37.892076 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 476/969] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:37 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:47:38.915607 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:38.916247 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:38.922681 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:38.923159 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:38.923595 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:38.924278 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:38.924726 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:38.925177 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:39.059069 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.policy [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:47:39.067881 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-0928f45b-5095-4d07-984d-564954735a05 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1578 microversion: 2.1 time: 0.157076 Sep 15 12:47:39.068594 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 494/970] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:38 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:47:40.091590 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:40.092193 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:40.099113 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:40.099597 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:40.100040 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:40.100732 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:40.101217 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:40.101642 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:40.242075 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.policy [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593948925ca642c196cbdef04985374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '923986fe38f542549682ddff9eb63ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 12:47:40.250003 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-6d877c32-612f-439b-8991-cc175d53fe77 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 200 len: 1459 microversion: 2.1 time: 0.162448 Sep 15 12:47:40.250581 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 477/971] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:40 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 1459 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 12:47:40.259873 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [req-0c5e2cf5-a122-4364-ab42-48630be7a6c6 req-bc952c67-7b3b-4ae9-aeb4-7a2ca6996905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cae46b-26d0-461d-bc1b-65eee2f14e04", "name": "network-vif-deleted", "tag": "4503fbf9-612b-4a2c-9e2c-b2b2b089a007"}]} {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 12:47:40.270748 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-0c5e2cf5-a122-4364-ab42-48630be7a6c6 req-bc952c67-7b3b-4ae9-aeb4-7a2ca6996905 service nova] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:40.271227 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-0c5e2cf5-a122-4364-ab42-48630be7a6c6 req-bc952c67-7b3b-4ae9-aeb4-7a2ca6996905 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:40.271660 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [req-0c5e2cf5-a122-4364-ab42-48630be7a6c6 req-bc952c67-7b3b-4ae9-aeb4-7a2ca6996905 service nova] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:40.282826 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.compute.server_external_events [req-0c5e2cf5-a122-4364-ab42-48630be7a6c6 req-bc952c67-7b3b-4ae9-aeb4-7a2ca6996905 service nova] Creating event network-vif-deleted:4503fbf9-612b-4a2c-9e2c-b2b2b089a007 for instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 on hv-cinder-85083 Sep 15 12:47:40.288047 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [req-0c5e2cf5-a122-4364-ab42-48630be7a6c6 req-bc952c67-7b3b-4ae9-aeb4-7a2ca6996905 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032484 Sep 15 12:47:40.288646 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 495/972] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 12:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 12:47:41.273237 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:41.273961 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: c0cae46b-26d0-461d-bc1b-65eee2f14e04] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:41.280891 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:41.281365 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:41.281799 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:41.282476 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:41.282926 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:41.283346 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:41.296287 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] HTTP exception thrown: Instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 could not be found. Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Request method failure captured: Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 HTTP/1.1 Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIx1N0rl3dv3bXxSyFA61Y8rtAhXGm7R6GDG1njA14cEk0SBQlszQ8vtyjwWRHtJ4C4ieP2uEQzmuUM_4uKukpzKKi3cb-oeWSOt2sA-TyoZxwOk6zCEjGnPBvOBRam1P33waZOjLhHM79N2r5rDeG7DXo51X7gv43Xpp1i5IMCGMuFk Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:47:41.297923 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_923986fe38f542549682ddff9eb63ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 593948925ca642c196cbdef04985374f Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 could not be found. Sep 15 12:47:41.299791 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': 'c0cae46b-26d0-461d-bc1b-65eee2f14e04'} Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 could not be found. Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:47:41.300679 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 could not be found. Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 could not be found. Sep 15 12:47:41.302941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.304434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Returning 404 to user: Instance c0cae46b-26d0-461d-bc1b-65eee2f14e04 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:47:41.304434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-be8f7c58-e9cf-4621-9704-bbd3749b8c30 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04" status: 404 len: 111 microversion: 2.1 time: 0.030024 Sep 15 12:47:41.304434 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 478/973] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:41 2022] GET /compute/v2.1/servers/c0cae46b-26d0-461d-bc1b-65eee2f14e04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:47:41.736358 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:41.736973 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.compute.api [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:41.744017 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:41.744498 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:41.744969 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:41.745654 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:41.746104 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:41.746525 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG oslo_concurrency.lockutils [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:41.760001 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.wsgi [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] HTTP exception thrown: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Request method failure captured: Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: request: DELETE /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 HTTP/1.1 Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept: application/json Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Accept-Encoding: identity Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Connection: close Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Length: 0 Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Content-Type: application/json Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Host: 10.222.0.15 Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: Openstack-System-Scope: None Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: User-Agent: python-urllib3/1.26.12 Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Auth-Token: gAAAAABjIx1N0rl3dv3bXxSyFA61Y8rtAhXGm7R6GDG1njA14cEk0SBQlszQ8vtyjwWRHtJ4C4ieP2uEQzmuUM_4uKukpzKKi3cb-oeWSOt2sA-TyoZxwOk6zCEjGnPBvOBRam1P33waZOjLhHM79N2r5rDeG7DXo51X7gv43Xpp1i5IMCGMuFk Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Id: None Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Domain-Name: None Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Identity-Status: Confirmed Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Is-Admin-Project: True Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Id: default Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Domain-Name: Default Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Project-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Role: reader,member Sep 15 12:47:41.761684 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Roles: reader,member Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_923986fe38f542549682ddff9eb63ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-Tenant-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Id: default Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Domain-Name: Default Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Id: 593948925ca642c196cbdef04985374f Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: X-User-Name: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: method: > Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: exception: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.763420 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: action_args: {'id': '48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6'} Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:47:41.764347 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.765739 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.767106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Returning 404 to user: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. {{(pid=120437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:47:41.767106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-96c9088f-b962-44b3-80b3-03c418f45823 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 404 len: 111 microversion: 2.1 time: 0.032007 Sep 15 12:47:41.767106 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 496/974] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 12:47:41 2022] DELETE /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 12:47:41.771871 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '>' {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:41.772485 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.compute.api [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] [instance: 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6] Fetching instance by UUID {{(pid=120436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 12:47:41.778427 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:41.778902 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:41.779328 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:41.779998 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Acquiring lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 12:47:41.780442 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 12:47:41.780884 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG oslo_concurrency.lockutils [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Lock "6933a6ed-ec74-4c8d-8925-fcb2307d9c1c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 12:47:41.794721 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.wsgi [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] HTTP exception thrown: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Request method failure captured: Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: request: GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 HTTP/1.1 Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept: application/json Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Accept-Encoding: identity Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Connection: close Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Length: 0 Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Content-Type: application/json Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Host: 10.222.0.15 Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: Openstack-System-Scope: None Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: User-Agent: python-urllib3/1.26.12 Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Auth-Token: gAAAAABjIx1N0rl3dv3bXxSyFA61Y8rtAhXGm7R6GDG1njA14cEk0SBQlszQ8vtyjwWRHtJ4C4ieP2uEQzmuUM_4uKukpzKKi3cb-oeWSOt2sA-TyoZxwOk6zCEjGnPBvOBRam1P33waZOjLhHM79N2r5rDeG7DXo51X7gv43Xpp1i5IMCGMuFk Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Id: None Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Domain-Name: None Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Identity-Status: Confirmed Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Is-Admin-Project: True Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Id: default Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Domain-Name: Default Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Project-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Role: reader,member Sep 15 12:47:41.796239 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Roles: reader,member Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_923986fe38f542549682ddff9eb63ff1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/923986fe38f542549682ddff9eb63ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Id: 923986fe38f542549682ddff9eb63ff1 Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-Tenant-Name: tempest-TestVolumeBootPattern-228125241 Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Id: default Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Domain-Name: Default Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Id: 593948925ca642c196cbdef04985374f Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: X-User-Name: tempest-TestVolumeBootPattern-228125241-project Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: method: > Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: exception: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.797958 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: action_args: {'id': '48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6'} Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: {{(pid=120436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 12:47:41.798941 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. Sep 15 12:47:41.800458 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: ERROR nova.api.openstack.wsgi Sep 15 12:47:41.802400 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: DEBUG nova.api.openstack.wsgi [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Returning 404 to user: Instance 48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 could not be found. {{(pid=120436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 12:47:41.802400 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: INFO nova.api.openstack.requestlog [None req-9d7400cd-476f-489e-bcaf-ca5b76f6e804 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6" status: 404 len: 111 microversion: 2.1 time: 0.029699 Sep 15 12:47:41.802400 dv-cinder-850836-7-iscsi devstack@n-api.service[120436]: [pid: 120436|app: 0|req: 479/975] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 12:47:41 2022] GET /compute/v2.1/servers/48e4f4a6-7e72-4e5a-b4c9-270f93bfb1e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 12:47:43.091419 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: DEBUG nova.api.openstack.wsgi [None req-03cfbcdc-13e3-4429-97d9-9156ee2833a9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] Calling method '.version_select at 0x7ff0d050ea60>' {{(pid=120437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 12:47:43.123478 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: INFO nova.api.openstack.requestlog [None req-03cfbcdc-13e3-4429-97d9-9156ee2833a9 tempest-TestVolumeBootPattern-228125241 tempest-TestVolumeBootPattern-228125241-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-432651685" status: 202 len: 0 microversion: 2.1 time: 0.035771 Sep 15 12:47:43.124010 dv-cinder-850836-7-iscsi devstack@n-api.service[120437]: [pid: 120437|app: 0|req: 497/976] 10.222.0.15 () {58 vars in 1260 bytes} [Thu Sep 15 12:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-432651685 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)